Skip to content

Extract trace and artifact signals into run summaries - #40

Merged
evandhoffman merged 1 commit into
mainfrom
codex/issue-37-trace-and-artifact-signals
Apr 19, 2026
Merged

evandhoffman merged 1 commit into
mainfrom
codex/issue-37-trace-and-artifact-signals

Conversation

@evandhoffman

Copy link
Copy Markdown
Collaborator

Closes #37.

What changed

  • summarize trace behavior into stable per-run counters for assistant answers, verification/self-correction markers, format-fixation markers, duplicates, and total trace lines
  • snapshot the workspace so each run summary records created/modified file counts alongside app.py hash, size, LOC, route count, inline-html usage, and dependency count
  • add helper coverage plus an end-to-end summary test that writes representative trace and workspace artifacts through _run_one

Verification

  • uv run python -m unittest tests.test_runner
  • uv run python -m unittest discover tests

@evandhoffman
evandhoffman merged commit c25e063 into main Apr 19, 2026
1 check passed
@evandhoffman
evandhoffman deleted the codex/issue-37-trace-and-artifact-signals branch April 19, 2026 12:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Extract trace and code artifact signals from benchmark runs

1 participant