Skip to content

fix(audit): emit audit.finding_count so Ops stops flagging plugin_skill entities - #23

Merged
chrispezza merged 1 commit into
mainfrom
fix/audit-finding-count-metric
Oct 11, 2026
Merged

chrispezza merged 1 commit into
mainfrom
fix/audit-finding-count-metric

Conversation

@chrispezza

Copy link
Copy Markdown
Contributor

Why

Ops dashboard finding: audit.finding_count never reported. Ops (src/config.ts EXPECTED_METRICS) expects audit.finding_count on every plugin_skill entity; scripts/publish_skill_audit.py only emitted skill_audit.*, which Ops has no knowledge of.

What

  • Publisher emits one audit.finding_count signal per entity (valueNum = linked findings, severity 0 since audit.* is advisory and skill_audit.findings carries the rank).
  • Test covers non-zero and zero counts; docs/SKILL_AUDITS.md signal table updated (five → six).

Not done here

The metric only arrives after the next publish. That needs the 1Password prompt approved, so it is left to the maintainer:
op run --env-file <env-with-OPS_INGEST_TOKEN-ref> -- python3 scripts/publish_skill_audit.py docs/audits/2026-09-05-post-fix/audit.json --publish (with OPS_URL set).

Checks

validate_plugins.py OK; unittest discover 9/9; no hook files touched (shellcheck not installed locally, CI runs it).

🤖 Generated with Claude Code

…ll entities

Ops expects audit.finding_count on every plugin_skill entity but the
publisher only emitted skill_audit.*, which Ops does not know, so the
metric was reported missing after every publish. Emit it at severity 0
(audit.* is advisory; skill_audit.findings still carries the rank).

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@chrispezza
chrispezza merged commit 050c8df into main Oct 11, 2026
2 checks passed
@chrispezza
chrispezza deleted the fix/audit-finding-count-metric branch October 11, 2026 18:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant