Skip to content

Studio · task 0.7 — golden-file harness (measure the tolerance first) #70

Description

@aliakherati

Phase 0, task 0.7 — see docs/studio/plan/PHASE_0.md.

The first task is a MEASUREMENT, not an assertion. Re-run two archived cases at today's submodule SHAs and record the observed per-quantity deviation in studio/tests/golden/REFERENCE_TOLERANCES.md, together with those SHAs. Bit-for-bit reproduction is a hypothesis (ASSUMPTION-2), not a premise: the archived ensemble has no provenance record and the solver has changed since it was produced.

  • Tier A (-m tier_a, CI, seconds): schema/units/DAG/hash/expansion tests + one 1-day, 40-bin run.
  • Tier B (-m tier_b, nightly/manual): 4–6 curated cases across D1/D2/D3/burst × sabr220/sabr330.

Fixtures store a documented uniform-stride reduction, not the 3.6 MB npz — uniform because an adaptive grid aliases the nucleation burst by up to 8×.

Do not re-baseline a deviation into a passing test without recording what it was and why.

Base branch: studio/dev.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    studioPlume Studio (studio/, docs/studio/)

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions