Skip to content

Record the Phase 3 (linear arm) descope and retract the S10 erratum - #315

Merged
jaredgalloway merged 1 commit into
mainfrom
293-descope-linear-arm
Aug 18, 2026
Merged

Record the Phase 3 (linear arm) descope and retract the S10 erratum#315
jaredgalloway merged 1 commit into
mainfrom
293-descope-linear-arm

Conversation

@jaredgalloway

Copy link
Copy Markdown
Member

What

EPIC #290 will no longer deliver its Phase 3 linear (Identity) baseline arm.
The work has been migrated to #293 as a standalone issue. This PR records
the consequences in HANDOFF.md, the document a fresh maintainer reads cold.

The issue-surface changes were made directly on GitHub and are already live:

Issue Change
#293 Retitled to a standalone name; body retains the full spec verbatim with a provenance banner (§0) and five epic-coupling statements rewritten. Detached as a sub-issue of #290; no longer blocks #296.
#290 Scope-change banner; Phase 3 section marked DESCOPED; DAG redrawn with the 1 → 3 edge severed and 3,4,5 → 6 reduced to 4,5 → 6; S10 moved to the carried-over-unchanged list; action item 4 marked not-delivered; the S10 erratum landmine corrected in place.
#296 Unblocked (all three surviving blockers closed). Banner instructing that a missing S10 PDF is now correct, not an upstream bug. S10 moved to the carried-over list; the linear-vs-sigmoid gap removed from numbers-in-play.
#297 The instruction to surface the S10 erratum "regardless of what earlier phases decided" is withdrawn, with the supportable replacement sentence spelled out.

Why the erratum retraction is in scope

HANDOFF.md, #290, #296 and #297 all stated that legacy notebook cell 103
plots the sigmoid collection's CV loss inside the linear-model figure, making
published Figure S10 an erratum against the preprint.

The claim is false. #293's spec work recovered the notebook at
fc89753:notebooks/spike-analysis.ipynb — the previously cited 6c98b7b does
not resolve in this repo — and read it by 0-based cell index:

idx exec what it actually does
103 127 the linear fit call, not a loss call
105 132 cross_validation_df = linear_mc.get_conditional_loss_df() — linear, and read
106 133 renders shrinkage_analysis_linear_models

Execution counts are monotone 128 → 132 → 133, so the last write before S10
rendered was the linear one.

This mattered enough to fix now because the descope removes the safety net:
with no linear reproduction run left in the epic, nothing downstream would
have caught the claim before it reached the manuscript. Telling a co-author a
published preprint contains an erratum it does not contain is a worse failure
than reporting nothing.

The evidential limit is stated honestly in both #293 and HANDOFF.md: stored
execution counts record an execution order, not proof the saved PDF came
from it. But "unverified" is not "erratum", and only the weaker claim is
supportable today.

Verification

No code, config, or pipeline changes. Docs-only.

🤖 Generated with Claude Code

EPIC #290 will not deliver its linear (Identity) baseline arm. The work
migrated to #293 as a standalone issue carrying its full spec; #293 was
removed as a sub-issue of #290 and as a blocker of #296, which is now
unblocked with all three surviving blockers closed.

Update the epic's state section accordingly: mark Phase 3 descoped, correct
Phase 4 to landed (PR #311), note that no repo artifact implements the linear
arm yet, and state that SI Figure S10 is now carried over unchanged while the
linear-vs-sigmoid loss gap is unmeasured rather than unchanged.

Also retract the S10 erratum claim. The spec work on #293 recovered the legacy
notebook at fc89753 and found the claim false: cell 103 is the fit call, cell
105 (exec 132) rebinds cross_validation_df from the linear collection, and
cell 106 (exec 133) renders the figure, so the published middle panel is
linear-model loss. With Phase 3 descoped there is no reproduction run left in
the epic to catch the mistake, so the retraction has to be recorded here
rather than left to a later phase.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@jaredgalloway
jaredgalloway merged commit 9a77913 into main Aug 18, 2026
4 checks passed
@jaredgalloway
jaredgalloway deleted the 293-descope-linear-arm branch August 18, 2026 03:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant