Skip to content

feat(verify,debt): track test speed every phase, warn on slowdowns (#114) - #125

Merged
rshankras merged 1 commit into
mainfrom
feat/114-test-speed
Nov 7, 2026
Merged

rshankras merged 1 commit into
mainfrom
feat/114-test-speed

Conversation

@rshankras

Copy link
Copy Markdown
Owner

Closes #114. Skills half: rshankras/claude-code-apple-skills#70.

In plain words

Tests written by agents tend to get slower phase after phase, and nobody notices until every build takes ages. Now verify times the tests every phase and tells you in plain words when they got noticeably slower, naming the slowest ones. It never fails a phase for it.

What changed

  • New tested script templates/_scripts/test-times.sh. Runs the test command, times it, and reads per-test times from both XCTest and Swift Testing output. Records date, phase, seconds and test count in .planning/test-times.tsv, and keeps the 10 slowest in .planning/test-slowest.tsv. Warns when the suite is over 25% and at least 5 s slower than last time (so 2 s → 3 s isn't news), or any test takes over 10 s. Exits with the test command's own result.
  • verify 3.2 runs the suite through it. A warning becomes one Low issue naming the likely cause (an app launch per UI test, copied tests, real network or sleep). It's shown in VERIFICATION.md and the review guide.
  • debt tests lists every test over 10 s as a debt item; DEBT.md gets a "Slow tests" line.
  • Skills (feat(review): omission check — escalate under-reported findings up, not just down #70): "Keep Tests Fast" rules in testing/SKILL.md, pointed to from tdd-feature and test-generator.

Tests

12 new script tests. Five planted bugs (no 5 s floor, threshold too high, exit code swallowed, the "Test run with…" total counted as a test, 10 s limit too high): each caught, then reverted. The tests also caught a real bug while I wrote them: XCTest times were read as 0.

🤖 Generated with Claude Code

)

New tested script test-times.sh times the suite, records it in
.planning/test-times.tsv, keeps the 10 slowest tests, and warns (never
fails) on a >25% and >=5 s slowdown or any test over 10 s. verify uses it
in 3.2; debt tests lists slow tests as debt items.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@rshankras
rshankras merged commit 06845be into main Nov 7, 2026
2 checks passed
@rshankras
rshankras deleted the feat/114-test-speed branch November 7, 2026 04:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(verify,testing): watch test-suite speed so it doesn't quietly get slow

1 participant