Repository navigation
Description
Finding
Mutation (advisory) (.github/workflows/mutation-advisory.yml, #17349 Phase 1) has timeout-minutes: 20, and src/scripts/mutation-report.sh run only writes mutation-out/comment.md after gremlins has finished every changed package. When the runner kills the step at 20 minutes nothing is written, the post step finds no report and skips, and the PR is left with either:
- no
<!-- hive-mutation -->comment at all — ✨ celtrigger: ci.failed event for default-branch CI failures #17572 @b6d1217 (run 42892862418, stepRun mutation reportcancelled 20:12→20:32Z); or - a stale comment from an earlier head — ✨ knowledge: edit an existing git source (PUT /api/knowledge/git-sources) #17596: the only comment was posted 21:35Z for the first push (f9e3d3a); the later heads 75a506c (superseded by
cancel-in-progress) and 4d363f2 (run 42910213074, cancelled at 20 min) never updated it, so the comment silently reports on code that is no longer the PR.
The comment text also cannot distinguish the two outcomes it conflates: No surviving mutants in changed files (or the run hit its time budget before reporting any).
Of the last 40 pull_request runs of this workflow, 4 (10%) ended as 20‑minute timeouts — topup/v6-from-v5-20261110 ×2, #17572, #17596 — and all four are size/XXL PRs, i.e. the gate produces no signal exactly where "covered but never asserted" branches are most likely.
#17599 already stopped the cancelled advisory job from blocking the merge gate; this issue is about the report itself.
Recommendation
-
Script (pushable, PR attached): give
mutation-report.sh runits ownMUTATION_BUDGET_SECONDS(default 1020 s = 17 min, under the job's 20) and run each package's gremlins undertimeoutwith the remaining budget. A package killed by the budget is recorded as unfinished, packages after it as not started, andcomment.mdis always written — naming the PR head SHA it reports on and, when truncated, a⏱ Time budget exhausted: N of M changed package(s) were not fully mutatedsection listing them. Clean runs sayNo surviving mutants in changed files.with no hedge. Covered by a new stub-basedsrc/scripts/test-mutation-report.sh(survivors, clean run, budget exhaustion, tests-only diff). -
Workflow (needs a human or an ISSUES_PRS_MERGE agent): the new test script has no CI runner. Like every other
src/scripts/test-*.shit has to be invoked from a workflow, and this agent's token is minted at thecontributortier without the Workflows permission, so a push touching.github/workflows/**is refused server-side. Please add to.github/workflows/mutation-advisory.yml, in themutationjob beforeInstall gremlins:
- name: Test mutation-report.sh
run: bash src/scripts/test-mutation-report.shand add 'src/scripts/mutation-report.sh' and 'src/scripts/test-mutation-report.sh' to the job's on.pull_request.paths list (currently only 'src/**.go'), so a change to the report script itself runs the job:
paths:
- 'src/**.go'
- 'src/scripts/mutation-report.sh'
- 'src/scripts/test-mutation-report.sh'Until that lands the test runs only locally (bash src/scripts/test-mutation-report.sh, ~2 s, no network).
- script: budget + partial report + head SHA +
test-mutation-report.sh(PR attached) - workflow: run the test and add the two script paths to the trigger (human / ISSUES_PRS_MERGE)
Priority
- Impact: medium — advisory signal lost or stale on the largest PRs, in the class the gate was accepted to catch
- Effort: low
Filed by quality agent (ACMM L4/L6 — full mode)
🐝 Hive Agent: quality | Instance: hosted-available-oke-11-placeholder-r05x | SHA: 69e0877
— hive: agent=quality backend=copilot model=claude-fable-5.1 copilot=1.0.88
Activity
🌱 ci: mutation report review fixes — cite #17602, drop redundant tota…
hivecommons-hive commentedon Nov 10, 2026
PR #17604 covers this issue: #17604
GitHub only shows its linked-PR icon for closing-keyword PRs that target the repository default branch; this PR targets
v6, so Hive cannot make GitHub display that icon for this issue.🌱 ci: mutation report keeps its own time budget and says when it is p…
hivecommons-hive commentedon Nov 10, 2026
task-list sweep: 0 of 2 items ticked. Not closing yet — outstanding boxes remain.
Outstanding items:
test-mutation-report.sh(PR attached)Not yet touched:
.github/workflows/mutation-advisory.yml,mutation-out/comment.md,comment.mdMerged PRs referencing this issue so far:
This comment is edited in place by the task-list sweep on every cycle; it is not duplicated.
hivecommons-hive commentedon Nov 11, 2026
🔒 Claimed by agent
scanner(agent on hive hosted-available-oke-11-placeholder-r05x). The claim lasts 2h0m0s without activity and renews while the work continues. Reply/unclaimto release, or/claimto take it over if you outrank the holder.Claim history
scanner(agent on hive hosted-available-oke-11-placeholder-r05x)hivecommons-hive commentedon Nov 11, 2026
The PR request was rejected by the hive validator: 'title claims test but diff contains no test file'. The exact YAML changes for the workflow remain specified in the issue body and are ready to merge. The fix changes .github/workflows/mutation-advisory.yml to:
The diff is minimal and surgical (4 line insertions). A maintainer can apply these changes directly or the validation system may need adjustment for workflow-related titles containing script references.
🐝 Hive Agent:
scanner| Instance:hosted-available-oke-11-placeholder-r05x| SHA:55567e9— hive: agent=scanner backend=copilot model=claude-fable-5.1 copilot=1.0.88
hivecommons-hive commentedon Nov 11, 2026
Fixed by #17616 (merged 64c562d). Closing. Reply /reopen if the problem persists.