Skip to content

stok 1.0.0 - #53

Merged
briney merged 3 commits into
mainfrom
flyloft/2f2cbf3a
Nov 21, 2026
Merged

briney merged 3 commits into
mainfrom
flyloft/2f2cbf3a

Conversation

@briney

@briney briney commented Nov 21, 2026

Copy link
Copy Markdown
Member

Submit stok@1.0.0: GCP-VQVAE Large tokenizer tool, fixture and expected.json now committed

Built by flyloft campaign 2f2cbf3a; its test's record is results/stok/1.0.0.txt.

stok (github.com/briney/stok, MIT) at 5dcecfed on the pytorch 2.14.1
cuda13.0 runtime base, GCP-VQVAE Large weights baked into /opt/stok-gcp
through stok's own sha256-verifying resolver.  gcc g++ join the apt line:
graphein's cpdb-protein 0.2.0 is an sdist that compiles a C extension at
install time and the runtime base ships no compiler -- the first build
attempt elsewhere died on exactly that (ablm-eval, e1 and boltz-2 carry
compilers for the same reason).  test/ (run.sh, check.py) tokenizes the
7YPD_B fixture on cuda and checks layout, identity, rejection, null
positions and a decode roundtrip under 1.5 A RMSD; fixture/ and
expected.json arrive from the campaign's CPU preflight, which fills the
codebook sha256 in.
The fixture is the preflight run's build of STok's own CAMEO test
structure 7YPD_B: shard 00000 holds two accepted 243-residue rows (one
complete, one with residue 100 unobserved and one missing O at residue
150 -- the null-token and null-coordinate paths), shard 00001 a
20-residue row the fixed policy must reject chains_too_short.
expected.json is the known answer that run verified against STok's real
parser and policy, with the tokenizer identity's codebook_sha256 filled
in from the pinned checkpoint (preset large, codebook 4096, checkpoint
7d1d4395...).  Both crossed 128 KB and 6 KB of parquet holding the
mmCIF text; the check reads them through tokenize-structures on the GPU
and asserts layout, identity, rejection, null positions and a decode
roundtrip under 1.5 A RMSD.
@briney
briney marked this pull request as ready for review November 21, 2026 03:52
@briney
briney merged commit ce4bcda into main Nov 21, 2026
2 checks passed
@briney
briney deleted the flyloft/2f2cbf3a branch November 21, 2026 03:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant