Playbook submissions live under playbooks/ and are reviewed automatically on every pull request.
Phase 1 is implemented:
- strict format validation based on filename-inferred playbook type
- internal repo link checks
- Markdown table checks
- trailing whitespace checks
- placeholder detection for unreplaced
{...}content
Phase 2 is implemented as an advisory AI review:
- GitHub Models-based clarity feedback in CI
- PR annotations for ambiguous wording, weak flow, vague steps, and inconsistent terminology
- non-blocking guidance that runs after the format validator passes
Phase 3 is planned:
- AI-assisted technical completeness review
- advisory findings for likely incorrect claims, overclaims, and missing technical context
- implementation design in
docs/technical-completeness-phase.md
Expected filename patterns:
platform-feature-<slug>.mdplatform-feature-<slug>-risk-<slug>.mdplatform-feature-<slug>-risk-<slug>-control-<slug>.md
Run the validator locally with:
node scripts/validate-playbooks.mjsRun the advisory clarity reviewer locally with:
GITHUB_TOKEN=your_token_here node scripts/clarity-playbooks.mjsRun the advisory technical completeness reviewer locally with:
GITHUB_TOKEN=your_token_here node scripts/completeness-playbooks.mjsRun the clarity parser tests with:
node --test scripts/clarity-playbooks.test.mjsRun the technical completeness parser tests with:
node --test scripts/completeness-playbooks.test.mjsSmoke-test checklist after pushing:
- Open a pull request that changes at least one Markdown file under
playbooks/. - Confirm the
Review Playbooksworkflow starts automatically for that pull request. - Confirm the format review step passes or fails as expected for the changed playbook.
- If the format review passes, confirm the advisory clarity review step runs afterward.
- Confirm the advisory technical completeness review step runs after the clarity review step.
- Confirm the pull request shows
Playbook clarityandPlaybook technical completenessannotations, or notices saying no suggestions were found. - If an AI review step reports a GitHub Models access error, verify that GitHub Models is available for the repository or organization and rerun the workflow.