Skip to content

Optional metadata.count and metadata.unit in each dataset's skill - #21

Merged
briney merged 1 commit into
mainfrom
metadata-count
Nov 20, 2026
Merged

briney merged 1 commit into
mainfrom
metadata-count

Conversation

@briney

@briney briney commented Nov 20, 2026

Copy link
Copy Markdown
Member

Closes #20. flyloft's Datasets page (brineylab/flyloft#303) shows each dataset's entry count when the skill names it; this adds the fields here.

Fields: optional, together, under metadata: count (the version's whole number of entries, digits only) and unit (what an entry is).

No version bumps. scripts/changed-datasets now diffs with -I '^ (count|unit):', so a change only to those lines isn't a dataset change and CI doesn't run check --hub on it (which would fail on the already-published tag). Any other edit to the skill still counts. The rest of the version rule is unchanged; CONTRIBUTING, AGENTS, and DESIGN state the exception.

Checks: check.py refuses a non-digit count and a count without unit (or the reverse). A new unit test runs rules() on every dataset, so count-only edits are still checked in CI.

Counts (from each skill or its record):

dataset count unit
afdb-rep 2278845 structures
afdb-swissprot 542378 structures
antigen-specific-antibody-database 1177819 records
hello 300 pairs
jaffe-paired 1186496 pairs
oplm-antibody-sequences 299748717 sequences
uniref50 41243524 sequences
uniref90 125724408 sequences
uniref100 227086028 sequences

Worth a look in review:

python3 -I -m unittest discover tests: OK.

🤖 Generated with Claude Code

flyloft's Datasets page shows a dataset's entry count when its skill names
one. Two optional frontmatter fields, together: count (digits only) and
unit (what an entry is).

- check.py: count is digits, and count and unit come together.
- changed-datasets: a change only to count/unit lines is not a change, so
  adding them to a published version needs no new version.
- A unit test runs the rules on every dataset, so a count-only edit is
  still checked.
- Every existing skill gets its count, from its skill or record.
- CONTRIBUTING, AGENTS, DESIGN: the fields and the version exception.

Closes #20

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@briney
briney merged commit 64d47a4 into main Nov 20, 2026
1 check passed
@briney
briney deleted the metadata-count branch November 20, 2026 17:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Optional metadata.count and metadata.unit in each dataset's skill

1 participant