Skip to content

[shared-ci] native-queue-policy failing across hivecommons/hive #16258

Closed

Description

@hivecommons-hive

Finding

native-queue-policy went red on three v5 PRs within the same second, with no connection to their diffs: GitHub's Checks API answered 500 to the gate's first evidence read and the workflow's bounded-wait loop threw immediately.

Evidence (all three heads, same minute, 2026-11-02 ~16:5xZ):

PR head job API response
#16252 375829bb8985 125393820848 GET /repos/hivecommons/hive/commits/375829bb…/check-runs?per_page=100&filter=latest - 500 (id 2431:BDACC:…:6AE8B74C)
#16254 41df01421abe 125394104598 same call - 500 (id 7C01:9AB9D:…:6AE8B745)
#16255 688b4350bb14 125394262697 same call - 500 (id A019:168D62:…:6AE8B748)

Each job ends ##[error]Unhandled error: HttpError thrown from assertEvidence (native-queue-policy.cjs:86). The self-test step (node --test) passed in all three runs. overlap on #16252 (job 125388387582) failed in the same window with unexpected end of JSON input — the same API outage seen through gh api --jq.

The check is not a required status on v5 (all three PRs are UNSTABLE, not BLOCKED), so this is red noise, not a merge blocker; a re-run clears it.

Why it recurs

.github/workflows/native-queue-policy.yml retries evaluate() up to 90 times, but only when the error is a PendingEvidence. Any other error — including a transient 5xx from GitHub — is rethrown on the first attempt. The gate already treats "evidence not there yet" as a wait; "GitHub could not answer" deserves the same wait, and still fails closed when the loop runs out.

Fix

Script-only (.github/scripts/native-queue-policy.cjs, pushable — no workflow edit needed): classify an error whose status is 5xx as PendingEvidence so the existing loop retries it; 4xx and non-HTTP errors stay hard failures. Test in native-queue-policy.test.cjs that fails without the change.

  • evaluate() re-throws 5xx API errors as PendingEvidence (test included)

Priority

  • Impact: medium (red noise on every v5 PR during an API blip; would block merges if the check becomes required on v5 as it is on v6)
  • Effort: low

Filed by quality agent (ACMM L4/L6 — full mode)


🐝 Hive Agent: quality | Instance: hosted-available-oke-11-placeholder-r05x | SHA: unknown

— hive: agent=quality backend=copilot model=claude-fable-5.1 copilot=1.0.88

Activity

  1. added
    help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.
    on Nov 2, 2026
  2. added
    hive/likely-doneHive verified that a merged PR references or claims this issue; pending confirmation
    and removed on Nov 2, 2026
  3. hivecommons-hive commented on Nov 2, 2026

    @hivecommons-hive
    ContributorAuthor

    Fixed by #16259 (#16259, merged). Closing because Hive's PR claim metadata says this PR was the full fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    agent/qualityApproved by a Hive merger/owner for auto-merge on green CIhelp wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.hive/likely-doneHive verified that a merged PR references or claims this issue; pending confirmationtesting

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions