Skip to content

[Eval 2/2] evaluate next-frame open-loop chunks and videos from measured anchors - #299

Draft
AnikethCheluva wants to merge 1 commit into
codex/arc-rebuild/19-distance-budget-dtwfrom
codex/arc-rebuild/20-open-loop-stream-evaluation
Draft

AnikethCheluva wants to merge 1 commit into
codex/arc-rebuild/19-distance-budget-dtwfrom
codex/arc-rebuild/20-open-loop-stream-evaluation

Conversation

@AnikethCheluva

@AnikethCheluva AnikethCheluva commented Oct 23, 2026 •

Copy link
Copy Markdown

Stack context

Eval 2/2 of the Cartesian ARC arrival-v2 review. Main stack: #311 (38 levels). Optional projection: #317, outside the main tip's ancestry. Parent: codex/arc-rebuild/19-distance-budget-dtw.

What and why

Thread each source sample's measured ARC anchor into decoding, metric records and videos. Compare t+1 onward for ARC, leave baseline same-index behavior intact. Retire chunking selectors; keep caller episode bounds.

Needed / not carried forward

This level supplies the capability named above. The integrated stack has one canonical Cartesian codec, fixed independent-stream execution and model-declared decode context; it does not carry duplicate E1/legacy codecs or selectable race/joint-distance algorithms. Independent planar/simulation codecs remain outside this cleanup. No tests, fixtures or local verification scripts are committed. No training job or hardware session is launched.

Compatibility and verification

The full integration intentionally changes ARC targets: source starts at the next frame, row zero is incoming travel, and timing is measured from current proprio. Fresh compatible normalization and new experiment identities are required. Old checkpoints retain their recorded sources; same tensor width does not make them compatible. Complete experiment menus activate at the config integration level; intermediate helper PRs are not production launch candidates.

External CPU checks: 114 codec checks; 457 staged-codec checks; 93 inference/evaluator context checks; 282 open-loop oracle checks; 27 diagnostic checks; numerical post-tokenization statistics and next-frame source/preflight checks. All 325 current YAMLs resolve; 24 ARC and four baseline config-to-decoder context constructions pass. The optional projection extension passed 14 dedicated checks. These are integration receipts, not claims that every intermediate PR ran a complete training or hardware test.

AnikethCheluva commented Oct 23, 2026 •

Copy link
Copy Markdown
Author

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

@AnikethCheluva
AnikethCheluva force-pushed the codex/arc-rebuild/19-distance-budget-dtw branch from 747c2dd to ba5a2ba Compare October 23, 2026 20:06
@AnikethCheluva
AnikethCheluva force-pushed the codex/arc-rebuild/20-open-loop-stream-evaluation branch from 361c13e to 5fd5e81 Compare October 23, 2026 20:06
@AnikethCheluva AnikethCheluva changed the title eval: implement first-stream open-loop episode metrics and videos [ARC 10/11] implement first-stream open-loop episode metrics and videos Oct 23, 2026
@AnikethCheluva
AnikethCheluva force-pushed the codex/arc-rebuild/20-open-loop-stream-evaluation branch from 5fd5e81 to c571874 Compare October 23, 2026 20:38
@AnikethCheluva AnikethCheluva changed the title [ARC 10/11] implement first-stream open-loop episode metrics and videos [Pipeline 13/14] implement first-stream open-loop episode metrics and videos Oct 23, 2026
@AnikethCheluva
AnikethCheluva force-pushed the codex/arc-rebuild/19-distance-budget-dtw branch from 00fbd9c to 94b75aa Compare October 23, 2026 22:02
@AnikethCheluva
AnikethCheluva force-pushed the codex/arc-rebuild/20-open-loop-stream-evaluation branch from c571874 to 56df89f Compare October 23, 2026 22:02
@AnikethCheluva AnikethCheluva changed the title [Pipeline 13/14] implement first-stream open-loop episode metrics and videos [Eval 2/2] evaluate next-frame open-loop chunks and videos from measured anchors Oct 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant