Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .changeset/twenty-deer-act.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
---
---

Refresh the machine-pinned render baseline and its raw local evidence after the harness lockfile changed.
16 changes: 8 additions & 8 deletions bench/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -219,15 +219,15 @@ Relative wall-clock comparisons are a separate controlled operation:
bun run bench:check -- \
--baseline results/render-baseline.json \
--fresh results/render-fresh.json \
--power-mode performance \
--power-mode balanced \
--concurrency 1

# Explicit local diagnosis only. This prints a conspicuous NON-GATING banner
# and exact fingerprint-field mismatches; CI rejects this flag.
bun run bench:check -- \
--baseline results/render-baseline.json \
--fresh results/render-fresh.json \
--power-mode performance \
--power-mode balanced \
--concurrency 1 \
--report-only
```
Expand All @@ -237,10 +237,10 @@ median, p95, and MAD, and never selects a fastest round. A cell regresses only
when its reviewed ratio limit **and** its recorded absolute noise floor are both
exceeded.

No approved controlled baseline or matching controlled CI runner is configured
in this repository, so relative numeric claims are deliberately unavailable in
CI; `bench:check` fails closed until both exist. `ubuntu-latest` is not treated
as a controlled runner.
The approved baseline is machine-pinned and local; CI intentionally runs only
deterministic smoke matrices and broad safety ceilings, not wall-clock timing
comparisons. `bench:check` fails closed whenever the current harness, runner, or
declared controls differ from that baseline.

Generate reviewed baseline evidence separately from product optimizations:

Expand All @@ -249,13 +249,13 @@ Generate reviewed baseline evidence separately from product optimizations:
# candidate and retains the typed raw-round artifact. It does not touch the
# approved baseline.
bun run bench:baseline:candidate -- \
--power-mode performance \
--power-mode balanced \
--concurrency 1

# Promotion is intentionally explicit and must be reviewed as a standalone
# baseline-only diff:
bun run bench:baseline:candidate -- \
--power-mode performance \
--power-mode balanced \
--concurrency 1 \
--write-baseline
```
Expand Down
Loading
Loading