Repository navigation

Held-out token benchmark (heldout-v0): HowlFrame 1.31x Python on unseen tasks (measure only) - #136

Merged

howlcipher merged 2 commits into

mainfrom

Oct 12, 2026

Merged

Held-out token benchmark (heldout-v0): HowlFrame 1.31x Python on unseen tasks (measure only)#136
howlcipher merged 2 commits into
mainfrom
heldout-bench

Commits on Oct 12, 2026
- heldout-v0: freeze 32 held-out task specs (no solutions)
  howlcipher
  committed
  f510cd0
- heldout-v0: references, verifier, counts and report (HowlFrame 1.31x Python on held-out)
  howlcipher
  committed
  6ec0432