Skip to content

feat(plan-check): pre-implementation plan review agent + skill - #3

Merged
aliasunder merged 8 commits into
mainfrom
feat/plan-check-plugin
Sep 4, 2026
Merged

feat(plan-check): pre-implementation plan review agent + skill#3
aliasunder merged 8 commits into
mainfrom
feat/plan-check-plugin

Conversation

@aliasunder

Copy link
Copy Markdown
Owner

What

New plan-check plugin — the upstream counterpart to ship-check. One agent (plan-reviewer, fresh-eyes, findings-only) plus one skill (plan-review) that critiques implementation plans before any code exists.

Why

Premise flaws survive post-implementation review by construction: the code faithfully implements whatever the plan assumed, and mechanism review pronounces it well-built. Founding case: the OAuth client-registration cap passed all four ship-check phases; only manual review computed that one address under the rate limit fills the cap in ~75 minutes and locks the owner out.

Design

  • Skill carries the substance (portable per the cross-tool table in AGENTS.md); the agent is a thin dispatch wrapper — same split as ship-check.
  • 8 dimensions distilled from a sweep of real planning artifacts (plans, task notes, session-log decisions): problem framing, premise/assumption audit, alternatives + do-nothing baseline, guard/control arithmetic, concurrent writers & async state, scope/proportionality (incl. post-incident overcompensation), verification-plan quality (incl. blast radius of destructive test steps), structure & open-question hygiene.
  • Validated before merge: a fresh agent executed the skill verbatim against a historical task note (governance-roadmap-pr), produced 2 must-answer + 3 recommendation findings with quoted premises, and returned execution feedback — all five feedback items (verification-state pinning, docs two-sources-of-truth variant, checkable-now stop condition, must-answer/recommendation boundary, mandatory verification-basis line) are folded into this commit.

Registered in marketplace.json, root README table, and AGENTS.md structure tree. Version pinned at 1.0.3 for lockstep; next release bumps all fields together.

🤖 Generated with Claude Code

aliasunder and others added 2 commits September 2, 2026 21:20
… skill

plan-reviewer agent (fresh-eyes, findings-only) plus the plan-review skill:
8 dimensions distilled from real vault-cortex planning failures — premise
audit, alternatives + do-nothing baseline, guard/control arithmetic (the
OAuth client-cap denial-vector case), concurrent-writer analysis, post-
incident overcompensation check, verification blast radius. Upstream
counterpart to ship-check: it reviews premises before code exists;
ship-check reviews mechanisms after.

Registered in marketplace.json, root README table, and AGENTS.md structure.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread plugins/plan-check/skills/plan-review/SKILL.md Outdated
@umm-actually

umm-actually Bot commented Sep 3, 2026

Copy link
Copy Markdown

umm-actually re-reviewed at 74adc63

1 new finding(s) posted (4 tracked finding(s) across all runs).

Context notes
  • Priority docs already in context: README.md, plugins/ship-check/skills/pr-monitor/SKILL.md

umm-actually · deepseek/deepseek-v4-flash-0731

…lass

Step 6 said dimensions 4 and 6a are both conditional on the change
classification, but 6a's own trigger is whether the plan responds to a
recent incident — orthogonal to the five classes. A post-incident plan
classified 'feature' would have skipped the overcompensation check.
Reworded step 6 and the agent orientation to bind 6a to the incident
property. (umm-actually finding on PR #3.)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread plugins/plan-check/skills/plan-review/SKILL.md
aliasunder and others added 4 commits September 4, 2026 18:37
The plan-review skill instructs the agent to settle checkable-now
premises itself ("a read or grep settles it"), but the tool allowlist
omitted Grep and Glob — the same gap fixed for the ship-check phase
agents in #4.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
SKILL.md frontmatter does not recognize a tools: key (that field belongs
to agent definitions), so the declaration was inert. allowed-tools is the
recognized skill field — it pre-approves the listed tool for inline
invocation without restricting anything. Applied across plan-review and
the five ship-check skills carrying the same key.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
AGENTS.md trigger structure requires action + condition + boundary (or an
explicit always-applies). Three flags had neither: D1 no-one-named (now
shares the mechanical-task carve-out), D2 sourceless constraint (trace it
yourself when one search settles it), and D2 observation-promoted-to-
requirement (explicit reasoned preservation is fine; the flag is for
silent conversion).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Dimensions use Flag/Block verbs while the output contract counts
blockers / must-answer / recommendations, with only two dimensions
mapping between them explicitly. Added the mapping rule at the top of
the Dimensions section: Block is always a blocker; Flag resolves via
the guess test unless the dimension assigns severity itself.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread plugins/plan-check/README.md
… set

The premise audit reads task notes, boards, backlinks, and linked
research — the four-tool subset forced Bash workarounds for graph,
listing, and task queries. Adds the 20 read-only vault-cortex tools
under both server prefixes; write tools stay excluded (findings only).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread plugins/plan-check/skills/plan-review/SKILL.md
@aliasunder
aliasunder merged commit e6fb32a into main Sep 4, 2026
7 checks passed
@aliasunder
aliasunder deleted the feat/plan-check-plugin branch September 4, 2026 23:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant