Repository navigation
π research: ablation plan on consenting hives β cross-family reviewer + shadow gates, 30 days each (#12373) - #12400
Conversation
β¦ + shadow gates, 30 days each (#12373) Docs-only run plan for the pre-registration's two experimental arms: consent record per hive (Bluefin, Console, Hive), hash-of-hive-id arm order, 30-day periods with placeholder dates, exact hive.yaml diffs (review.shadow, intent.shadow, review_models.exclude_author_family + pool), one-revert rollback, metrics quoted verbatim from the pre-registration and where they are read (/api/evidence/summary shadow_gate and reviewer_accuracy_by_model, hub family_false_approve_rate, evidence export and backfill). Auto-merge unchanged everywhere; results reported win or lose. Linked from preregistration-2026-10.md (navigation only) and review-evidence.md. Signed-off-by: Andy Anderson <andy@clubanderson.com>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
Open PR overlap checkBase branch: Conflicts are checked with every PR merged onto the current tip of
|
|
merged by Hive trusted-author auto-merge: author @clubanderson holds role owner and GitHub permission admin on repo; CI green at 30ff020. |
|
Thank you for your contribution! Your PR has been merged. We'd love to hear how your experience was: share feedback |
Closes #12373. Docs only β nothing is switched on; consent is recorded on the issue before any start date.
Part of RFC #12062 (proposal C, Study). cc @mrbobbytables
What
src/docs/research/ablation-plan-2026-10.md(named to match the pre-registration's dated convention; the issue text says2026-Q4):review.shadow/intent.shadownever hold or weakenrequire_approval/enforce); the cross-family reviewer changes which model reviews, adds no approval requirement.sha256(hive id)first hex digit parity) decides arm order.TBDstart/stop placeholders and "who flips it".hive.yamlleaves (review.shadow,intent.shadow,agents.<reviewer>.review_models.{pool, exclude_author_model, exclude_author_family, fallback}), and a one-revert rollback./api/evidence/summaryshadow_gate+reviewer_accuracy_by_model, hub/api/hub/evidencefamily_false_approve_rate,hivectl evidence export(β¨ hivectl: evidence export --since --format csv|jsonl (same schema as the Evidence charts)Β #12367), backfill baseline (β¨ research: evidence backfill tooling + runs β Bluefin first, Console (L0βL6), then Hive/tunaos/Frostyard/Open HorizonΒ #12371).preregistration-2026-10.md(one navigation line under Tracking, explicitly not an amendment) andreview-evidence.md. Changelog fragmentadded-12373-ablation-plan.md.Guardrail (RFC #12062 Non-goals)
Record/read-only. Nothing here reads into or alters merge eligibility / auto-merge; no code changes.
Local:
check-docs-links.pyandcheck-docs-citations.pyclean.