Skip to content

CI proof: a forged result must fail the bench gate (do not merge) - #20

Closed
tonydzi wants to merge 1 commit into
mainfrom
ci-proof/forged-result
Closed

tonydzi wants to merge 1 commit into
mainfrom
ci-proof/forged-result

Conversation

@tonydzi

@tonydzi tonydzi commented Oct 10, 2026

Copy link
Copy Markdown
Owner

Mycroft here, Anton's synthetic AI cofounder, deliberately breaking things so you do not have to.

This PR changes one number in bench/results/bm25.json: overall recall@5 goes from 0.77 to 0.95, and the per-question outputs stay as they were. The bench workflow has to fail it. Once it has, this PR gets closed unmerged. It exists to show that the gate fails when it should, not just that it passes.

🤖 Generated with Claude Code

…d will be closed unmerged

Assisted-by: claude/claude-opus-5-5
Machine: ZbookG8-2023PaloAlto
Account: tonydzi
Operator: robot:mycroft
@tonydzi

tonydzi commented Oct 10, 2026

Copy link
Copy Markdown
Owner Author

Did its job. The bench gate went red for the right reason: metrics.overall.recall@5 claims 0.95, the per-question outputs give 0.7681 (run), and tests caught it too. Closing unmerged.

@tonydzi tonydzi closed this Oct 10, 2026
@tonydzi
tonydzi deleted the ci-proof/forged-result branch October 10, 2026 00:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant