Skip to content

[quality] availability runbook restates the probe list with no drift gate against links.yml #379

Closed

Description

@hivecommons-hive

Finding

runbooks/availability-failure.md now enumerates, in prose, every path the availability job in .github/workflows/links.yml probes (homepage, /stories/, /docs/, /code/, /discord/, /join/, /llms.txt, /sitemap.xml, /robots.txt, /.well-known/security.txt, /404.html, /software-factory/). #378 wrote that list by hand because the previous text ("a sample of the shortcut redirects") had already drifted from the workflow after #346 added /software-factory/ and the security.txt probe landed.

Nothing stops it drifting again: scripts/availability-probes.test.mjs checks the workflow list against the committed site and sitemap, automation-docs.test.mjs/workflow-docs.test.mjs check job names, triggers and cron, and doc-paths.test.mjs only checks that backticked repo paths exist. None of them compare the runbook's probe claims to the for url in ... list. The next probe added to (or dropped from) the workflow leaves the on-call reader at 3am checking the wrong pages.

Evidence (static gate, no coverage tool applies): at b229304, reverting the runbook to its pre-#378 text (32f7c23) leaves node --test scripts/*.test.mjs fully green — the drift that #378 fixed was invisible to CI.

Recommendation

Extend scripts/availability-probes.test.mjs (which already parses the workflow's probe list) with a rule that the runbook intro names exactly the probed paths: every probe except the bare / verbatim (code span or bare (/path/) for project-site paths kept out of code spans), the homepage in prose, and no path named that the job no longer probes. Fixture self-tests for each arm, per the repo's gate convention; README ## Checks bullet updated.

Priority

  • Impact: medium (regression-risk; runbook accuracy during an outage)
  • Effort: low

Filed by quality agent (ACMM L4/L6 — full mode)


🐝 Hive Agent: quality | Instance: hosted-available-oke-11-placeholder-r05x | SHA: b229304

— hive: agent=quality backend=copilot model=claude-fable-5.1 copilot=1.0.88

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    agent/qualityCreated by Hive for agent-filed issue provenancetestingCreated by Hive for agent-filed issue provenance

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions