Skip to content

docs: #162D certification completion report (NOT_CERTIFIED) - #179

Merged
ezutfen merged 1 commit into
mainfrom
162d-certification-report
Sep 5, 2026
Merged

docs: #162D certification completion report (NOT_CERTIFIED)#179
ezutfen merged 1 commit into
mainfrom
162d-certification-report

Conversation

@ezutfen

@ezutfen ezutfen commented Sep 5, 2026

Copy link
Copy Markdown
Contributor

Completes the operational phase of #176 (#162D): P3 kind-decoupled candidate certification against a fresh N=100 blind corpus.

Terminal decision: NOT_CERTIFIED

  • G0 parity PASS (100%), G1 PASS (+11pp, bootstrap CI [+5pp,+17pp]), G5 PASS (0 false eligibility), G6 PASS (0 automatic positives, ppv null, INSUFFICIENT_EVIDENCE), G7 PASS (signal honesty).
  • G2 FAIL: held-back reduction 14.29% vs the frozen 15% gate.
  • G3/G4 FAIL: P3 routes the single canonical high-consequence case (evidence-starved ordinary-kind doctrine content, labels require review) to defer with review=no — its review routing covers protected kinds and governance cases, not high-consequence evidence-starved ordinary kinds.

The doctrine was frozen and merged (PR #177/#178) before corpus selection; overlap with both spent corpora is zero on sample IDs AND content hashes; labels were frozen before reveal; the runner replayed deterministically. Full evidence in docs/162d-certification-completion.md and the content-free certification-report-162d-v1.json (report digest 7d6e593c…).

Includes a small fix: build_reviewer_b_packet enumerated a case field that production packets do not carry; it now numbers packet order directly (39 tests green, ruff+mypy clean).

No production behavior change. Parent #162 remains open.

Full operational run: fresh N=100 blind corpus (zero overlap with #162B/#162C
on sample IDs and content hashes), dual human review with operator
adjudication, labels frozen before reveal, deterministic evaluation.

Terminal decision: NOT_CERTIFIED. G0/G1/G5/G6/G7 pass (P0 parity 100%,
storage accuracy +11pp with CI [+5,+17]pp, zero false eligibility, zero
automatic positives). G2 fails at 14.29% vs 15%; G3/G4 fail because P3's
review routing misses the one canonical high-consequence evidence-starved
ordinary-kind case (routes defer+no-review where labels require review).
Automatic admission: INSUFFICIENT_EVIDENCE, ppv null.

Also fixes build_reviewer_b_packet to enumerate packet case order (packets
carry no case field).
@ezutfen
ezutfen merged commit 7f66c81 into main Sep 5, 2026
8 checks passed
@ezutfen
ezutfen deleted the 162d-certification-report branch September 5, 2026 19:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant