Skip to content

Add a report-only guide quality scorecard (#191) - #270

Merged
Jumpstile merged 1 commit into
mainfrom
feat/guide-quality-scorecard
Nov 17, 2026
Merged

Jumpstile merged 1 commit into
mainfrom
feat/guide-quality-scorecard

Conversation

@Jumpstile

Copy link
Copy Markdown
Owner

Part of #191 (Phase 1 guide truth, Milestone 1).

  • New pure scorecard and a report-only public command. It reads the outputs of the existing reports (Xguide comparison, category report, guide readiness, programme rows) and returns the six quality gates with counts and a plain reason each. Verdict rule for v1: any Fail-level finding fails the gate, else any Review-level finding gives Review, else Pass. No percentages until a real baseline exists.
  • Ambiguous or unknown categories are Review, never Pass. A gate with no input is NotMeasured, never Pass. Overall is the worst gate.
  • No channel is dropped: the output carries the input channel totals.
  • Report only. No build output, manifest hash, accepted state or frozen contract changes. One line added to FunctionsToExport.
  • Tests: new scorecard tests (8) plus manifest export, category report, Xguide summary and guide readiness tests all passed, 0 failed (pwsh).
  • Not tested: real ETV guide copies, Windows PowerShell 5.1, the full suite outside CI. Deduplication needs programme rows as a fourth input; the command takes report objects as parameters and does not collect them yet.

🤖 Generated with Claude Code

https://claude.ai/code/session_01NzHAcjThVoUGWWfXrYWsNh

A pure scorecard turns the existing guide reports into the six guide quality gates (accuracy, completeness, freshness, deduplication, classification, availability), each Pass, Review, Fail or NotMeasured with plain counts and a reason. Any Fail-level finding fails the gate, any Review-level finding makes it Review, ambiguous categories never pass, and a missing input report is NotMeasured, never Pass. A public Get-ChannelForgeGuideQualityReport command returns it. Report only: no build output, manifest hash or accepted state changes.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01NzHAcjThVoUGWWfXrYWsNh
@Jumpstile
Jumpstile merged commit 672ffec into main Nov 17, 2026
11 checks passed
@Jumpstile
Jumpstile deleted the feat/guide-quality-scorecard branch November 17, 2026 10:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant