Repository navigation
ci: distribute fresh mutations across verified native ranges - #53
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Integration refresh
Reviewed balancing implementation is unchanged at refreshed head
c6450a4511bad3e8a729a00a1bbc324a755e90dd(tree7d5bd0ca338e1d9fd73aa7134de447eedea57982). This merges current main853d878aa6fe242f151adfc0d1bc15083dd2529bonce to satisfy strict freshness. The delta from accepted head2a8db289is exactly PR51's four files:.github/workflows/ci.yml,docs/testing.md, and the two quick-start smoke files. All 13 balancing-change files are byte-for-byte unchanged. No timing-weight implementation is included.Required refreshed-head CI 40606063220 passed on
c6450a4511bad3e8a729a00a1bbc324a755e90dd: 21 successful jobs and three intentional skips, with both required check contexts green. Parent and independent source reviews cleared this exact refresh. The final artifact SHA-256 is5f78212048e5d6a349934c184158ae6f73626b0b15b9a1e483076965191c9bcf. Its audit independently reproduces: 1,289 exact native identities, all 331 declared input records, 31 test files, 1,224 killed / 34 timeout / 31 reviewed equivalents, 100% adjusted and zero reused results. The measured 8m32 acceptance below remains explicitly bound to its original commit; it is not relabelled as a run on this refreshed head.Final balanced acceptance — passed
One full acceptance run, 40601378445, passed on frozen head
2a8db289c59e14041859294a1df34defe5fa4a70(tree8794e9c71427bc2f303eb83a9ad9b96be63d221a), attempt 1. All 34 jobs completed successfully or were intentionally skipped by the selected workflow path.Observed total latency fell 36.3%; the parser window fell 42.2%, and summed parser shard job duration fell 12.5%. Total shard setup stayed 140s in both runs. Prerequisites were 19s faster, while planning and collection added 10s; the primary gain came from mutation execution. Summed native execution fell 1,466s → 1,197s (−18.3%); summed coverage dry runs rose 238.256s → 255.665s (+7.3%). Work remains uneven (max/median 2.78 versus 6.34), so this is a measured improvement, not an equal-runtime guarantee. The remaining largest cost is the complete 43-mutant
byte-reader.ts:98–131component; no follow-up source changes or additional acceptance runs were made.Raw evidence independently re-audited: 1,289 mutants = 1,223 killed + 38 timeout + 28 reviewed equivalents; 100% adjusted, 0 reused. Every mutant identity and outcome matches the accepted baseline. All 329 declared input digests match frozen Git blobs; all 11 parser sources, 31 test files, report digests, run/attempt/commit provenance and source-bound proofs match. The hosted audit reproduces exactly from unchanged reports.
The separate ordinary PR CI run, 40600554437, passed on
2a8db289: all required checks succeeded. Its cold native report independently re-audits to 1,289 mutants, 1,226 killed / 32 timeout / 31 reviewed equivalents, 100% adjusted and zero reused. Six timeout outcomes differ from the balanced run; all pass the existing audit and source-bound proofs. Artifact digest, all 329 input records and all 31 test-file sources were checked. The ordinary execution path is unchanged.PR50's fresh matrix still gives one entire hot source file to one runner. In accepted run 40591855465,
free-format-probe.tshad only 183 mutants but took 10m25s inside Stryker: its 75s coverage dry run inflated three method timeouts and one constructor timeout to about 105s each. Whole-file regrouping cannot shorten that straggler.This draft uses the already-locked native Stryker 10.1.1 instrumenter to discover complete overlapping mutant spans, then assigns larger components first to the least-populated of the same eleven parser jobs. Jobs use normal native
--mutateranges. Each assignment is re-instrumented, its complete union is checked, and collection compares every raw mutant identity with the freshly generated inventory. Missing, extra, duplicate or misplaced mutants fail. Raw reports, source-bound equivalence proofs, local test IDs, full test inventory, two workers and ordinary incremental/cache behavior are preserved.The new planner is 107 physical lines; the inventory validator is 29 lines plus small wiring/count aggregation changes. The complete diff is 13 files, +424/-49, mostly fixtures and tests. The direct instrumenter dependency already existed transitively at exactly 10.1.1; no new package graph or service is introduced. Planning now installs the lockfile. No historical duration database, custom cache matching, dependency graph or report rewrite is added.
Native-tool evidence and limits
Short validation at
2a8db289c59e14041859294a1df34defe5fa4a70Windows, Node 24.22.1 / npm 11.19.1:
After review, exactly one final full acceptance run was dispatched on the frozen head; its successful result is recorded above. No source changes or repeated acceptance runs were needed. The refreshed commit passed its own required checks and final source review; no additional full matrix campaign was needed for the unchanged balancing implementation.
Coordination: no quickstart/docs-PR files are changed. The separate clarity task overlaps
scripts/full-mutations.mjsandscripts/mutation-policy-inputs.mjs; this draft leaves helper names and existing scope diagnostic wording unchanged.