Skip to content

Publish completed ARC Kaggle run status - #35

Draft
zwright8 wants to merge 1 commit into
mainfrom
codex/publish-arcagi-evidence
Draft

zwright8 wants to merge 1 commit into
mainfrom
codex/publish-arcagi-evidence

Conversation

@zwright8

Copy link
Copy Markdown
Owner

What changed

  • updates the README Verified Training Results section with the controlled Kaggle-native ARC result
  • records Kaggle submission 55427691 as complete with blank public/private score fields
  • refreshes the sanitized metrics, CSV, and checksum manifest
  • adds regression assertions for the complete-but-unscored state

Why

The earlier public capsule recorded the Kaggle submission as pending. Kaggle has now completed it, but returned no official score. The documentation therefore publishes the verified visible base 0/52 versus LoRA 17/52 result while continuing to prohibit a sealed-improvement claim.

Validation

  • .venv/bin/python -m unittest tests.test_arcagi_strategy_student — 48 passed
  • .venv/bin/python -m compileall -q flightrecorder scripts tests examples/case_studies/arcagi_strategy_student
  • git diff --cached --check
  • staged privacy scan

No raw ARC examples, task identifiers, model weights, adapters, sealed outputs, private paths, or credentials are included.

Update Verified Training Results and the hash-bound ARC evidence capsule after Kaggle marked LoRA submission 55427691 complete with blank score fields.

Constraint: Publish only aggregate, privacy-safe run evidence and preserve the controlled visible comparison.

Rejected: Reporting an official sealed score or improvement when Kaggle returned no public or private score and the base arm remains unscored.

Confidence: high

Scope-risk: The completed submission is unscored, so the README retains an explicit no-sealed-improvement boundary.

Directive: Update sealed claims only after official scores exist for both controlled arms.

Tested: .venv/bin/python -m unittest tests.test_arcagi_strategy_student; .venv/bin/python -m compileall -q flightrecorder scripts tests examples/case_studies/arcagi_strategy_student; git diff --cached --check; staged privacy scan.

Not-tested: No additional Kaggle submission was made.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant