Problem
Suites with nondeterministic agents show the same case flip-flopping run-to-run. Today each flip reads as a regression and trains users to ignore CI.
Pattern
Follow app/api/demo/route.ts (prev-run pass-map logic) and dashboard app/page.tsx (suite aggregates). Add per-suite flip counts over the last N runs (endpoint or dashboard badge, e.g. GET /api/suites/:name/flaky), marking cases with >=2 flips as flaky.
Acceptance
New flaky signal (API field or badge). Test seeds alternating pass/fail histories and asserts the flip count and flaky flag.
Problem
Suites with nondeterministic agents show the same case flip-flopping run-to-run. Today each flip reads as a regression and trains users to ignore CI.
Pattern
Follow
app/api/demo/route.ts(prev-run pass-map logic) and dashboardapp/page.tsx(suite aggregates). Add per-suite flip counts over the last N runs (endpoint or dashboard badge, e.g.GET /api/suites/:name/flaky), marking cases with >=2 flips asflaky.Acceptance
New
flakysignal (API field or badge). Test seeds alternating pass/fail histories and asserts the flip count and flaky flag.