Skip to content

Project development analytics: balance map, KPIs, and the escaped-defect rate (spec) - #8

Merged
welsbach merged 6 commits into
mainfrom
spec-project-development-analytics
Jul 24, 2026
Merged

welsbach merged 6 commits into
mainfrom
spec-project-development-analytics

Conversation

@asdd-agent

@asdd-agent asdd-agent Bot commented Jul 24, 2026

Copy link
Copy Markdown

Summary

A spec proposal (OpenSpec change project-development-analytics) for a project-analytics section on the governance dashboard. No implementation in this PR.

It adds, on top of the existing stage buckets: a two-state summary (submitted PRs = the to-be state, merged PRs = the current-state); a read of what the work is about against the declared project goal and invariants; a six-dimension radar balance map (0 centre to 5 point) overlaying current-state and to-be; governance KPI ratios; an escaped-defect KPI framed as the review agent's false-negative rate; a temporal trend; and a minimum-signal note so a new project shows a note while a repo with history scores from it.

Two producer changes it depends on (specified here, built later): intake exposes the spec result as its own signal, and the review emits a machine-readable per-lens result so categories, malicious, and impact-core are queryable without scraping the rendered comment.

A worked HTML example of the whole view ships under design/analytics-example.html.

Contents: the OpenSpec change (proposal.md, tasks.md, specs/project-analytics/spec.md) and its builtin-format mirror at docs/specs/project-development-analytics.md.

Disclosure (required - ASDD)

  • Entirely human-authored
  • Authored or co-authored by an AI agent under human direction

Agent identity: asdd-agent
Instructed by (human handle): welsbach

Impact

  • Non-normative: a spec proposal that adds a new capability's requirements and a design example. It changes no gate, lens, or runtime behaviour in this PR; the producer changes it specifies land in their own implementation PRs.
  • Normative.

Checklist

  • Exactly one lane label (feature)
  • Signed off (git commit -s)

Christoph added 2 commits July 24, 2026 00:45
OpenSpec change proposal (no implementation). Adds a project-analytics
capability to the governance dashboard: a two-state summary (submitted =
to-be, merged = current-state), a topic read against the project goal and
invariants, a six-dimension radar balance map overlaying current-state and
to-be, governance KPI ratios, and the escaped-defect (green-then-bug) KPI
for building bug-free software.

Signed-off-by: Christoph <awchristoph@gmail.com>
- score the current-state from merged PRs; measure over an explicit,
  paginated window instead of only the most-recent page
- spec-conformance reads its own intake signal and excludes spec-exempt
  lanes; the review emits a machine-readable per-lens result so categories,
  malicious, and impact-core are queryable without scraping the comment
- to-be excludes changes-requested PRs; Verification and Documentation
  exclude non-applicable PRs from their denominators
- escaped-defect framed as the review false-negative rate, linkable from a
  bug PR or a bug-labelled issue; add a temporal trend; a minimum-signal note
  per metric so a new project shows a note and an existing repo scores from
  history
- add the builtin-format spec mirror and a worked HTML design example

Signed-off-by: Christoph <awchristoph@gmail.com>
@asdd-agent
asdd-agent Bot requested a review from welsbach as a code owner July 24, 2026 08:01
@github-actions

Copy link
Copy Markdown

ASDD review - advisory (recommendation: comment)

Produced by an automated agent under human direction. Advisory only: a human approves and merges.
Nothing here merges automatically.

This change is 2317 lines, over the 2000-line review cap, so the model lenses did not run. That cap exists because a model call costs money and an unbounded diff would let one pull request drain the budget. Split it into reviewable pieces, or raise review.max_diff_lines if the project wants to pay for changes this size. The deterministic security checks below still ran. Security scan (deterministic + SAST): no new issues. Impact scan: 1 finding(s), 0 block.

CODE - skipped

No findings.

SECURITY - ok

No findings.

SPEC - skipped

No findings.

QUALITY - skipped

No findings.

IMPACT - concerns

  • warn: This change touches a behavioural surface (a gate, lens, agent prompt, or the runtime seam: .github/asdd/runtime/openai-compat.sh, agents/runtime.md, asdd_cli.py, cli/README.md, cli/audit.py). If it changes behaviour adopters rely on for conformance, it is normative: declare it and add an impact analysis and target version. If it preserves behaviour, no action.

Generated by the ASDD advisory review. Mode: skipped-too-large.

…gn example

Remove the worked HTML example from the change so the diff stays under the
review cost cap and the model review runs on the proposal itself. The example
remains available as a design reference; the proposal, tasks, and mirror now
describe it without an in-repo path.

Signed-off-by: Christoph <awchristoph@gmail.com>
@github-actions

Copy link
Copy Markdown

ASDD review - advisory (recommendation: comment)

Produced by an automated agent under human direction. Advisory only: a human approves and merges.
Nothing here merges automatically.

This change is 2060 lines, over the 2000-line review cap, so the model lenses did not run. That cap exists because a model call costs money and an unbounded diff would let one pull request drain the budget. Split it into reviewable pieces, or raise review.max_diff_lines if the project wants to pay for changes this size. The deterministic security checks below still ran. Security scan (deterministic + SAST): no new issues. Impact scan: 1 finding(s), 0 block.

CODE - skipped

No findings.

SECURITY - ok

No findings.

SPEC - skipped

No findings.

QUALITY - skipped

No findings.

IMPACT - concerns

  • warn: This change touches a behavioural surface (a gate, lens, agent prompt, or the runtime seam: .github/asdd/runtime/openai-compat.sh, agents/runtime.md, asdd_cli.py, cli/README.md, cli/audit.py). If it changes behaviour adopters rely on for conformance, it is normative: declare it and add an impact analysis and target version. If it preserves behaviour, no action.

Generated by the ASDD advisory review. Mode: skipped-too-large.

@github-actions

Copy link
Copy Markdown

ASDD review - advisory (recommendation: comment)

Produced by an automated agent under human direction. Advisory only: a human approves and merges.
Nothing here merges automatically.

The review runtime returned invalid output; a human should review manually. Security scan (deterministic + SAST): no new issues. Impact scan: 1 finding(s), 0 block.

SECURITY - ok

No findings.

IMPACT - ok

  • note: No normative text or behavioural surface touched; classified non-normative.

Generated by the ASDD advisory review. Mode: live.

@welsbach welsbach left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

check

@welsbach
welsbach merged commit ec15dca into main Jul 24, 2026
7 checks passed
@welsbach
welsbach deleted the spec-project-development-analytics branch July 30, 2026 16:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant