perf: add deterministic synthetic benchmark corpus - #379

Draft

seonghobae wants to merge 265 commits into

fix/public-markdown-resource-options-175from

feat/performance-envelope-375

This pull request is big! We're only showing the most recent 250 commits

Commits on Aug 20, 2026

test(perf): reject benchmark input output alias
seonghobae
committed
6a4dd66
fix(perf): preserve benchmark sample inputs
seonghobae
committed
a838dbe

Commits on Aug 21, 2026

test(perf): reject hard-linked summary evidence aliases
seonghobae
committed
fe61395
fix(perf): preserve hard-linked benchmark source evidence
seonghobae
committed
33d5c45
test(perf): prove oversized samples preflight whole-file reads
seonghobae
committed
676555f
fix(perf): bound benchmark sample reads before allocation
seonghobae
committed
72db249
test(perf): require immutable benchmark provenance
seonghobae
committed
9766bcf
feat(perf): bind summaries to immutable provenance
seonghobae
committed
738d3e7
test(perf): require strict UTF-8 benchmark evidence
seonghobae
committed
864fa8b
fix(perf): reject malformed UTF-8 benchmark evidence
seonghobae
committed
bc887c0
test(perf): preflight invalid summary destinations
seonghobae
committed
596c48e
fix(perf): preflight benchmark output destinations
seonghobae
committed
f072e74
test(perf): reject arbitrary benchmark metadata
seonghobae
committed
3efb68c
fix(perf): reject unsupported benchmark metadata
seonghobae
committed
6cb6418
test(perf): require explicit benchmark regression comparator
seonghobae
committed
ba35b28
feat(perf): add explicit benchmark regression comparator
seonghobae
committed
9504ead
test(perf): prove comparator rejects blocking FIFO inputs
seonghobae
committed
f5439a1
test(perf): prove summarizer rejects blocking FIFO inputs
seonghobae
committed
13c09c5
fix(perf): validate comparator inputs without blocking
seonghobae
committed
dbf5345
fix(perf): validate sample inputs without blocking
seonghobae
committed
e98faee
test(perf): reject dangling benchmark output symlinks
seonghobae
committed
d820150
fix(perf): reject dangling benchmark output symlinks
seonghobae
committed
42c9516
test(perf): fail closed on regression percentage overflow
seonghobae
committed
2b2f537
fix(perf): fail closed on regression percentage overflow
seonghobae
committed
712cd9d
test(perf): require provenance-bound regression receipts
seonghobae
committed
1604f20
fix(perf): bind regression receipts to exact evidence
seonghobae
committed
ceac649
test(perf): align comparator receipt contract
seonghobae
committed
4dc7984
test(perf): reject aliased summary destinations
seonghobae
committed
36af472
fix(perf): reject aliased summary outputs
seonghobae
committed
a869556
test(perf): reject vacuous same-artifact comparisons
seonghobae
committed
1902b63

Commits on Aug 22, 2026

fix(perf): reject same-artifact regression evidence
seonghobae
committed
a746787
test(perf): use distinct artifacts in comparator receipts
seonghobae
committed
8e32114
test(perf): reject private-looking benchmark evidence identifiers
seonghobae
committed
f6b87db
test(perf): keep hardware mismatch fixture privacy-safe
seonghobae
committed
b6fef32
fix(perf): constrain benchmark evidence identifiers
seonghobae
committed
4a7786c
fix(perf): validate comparison evidence identifiers
seonghobae
committed
37ec73e
test(perf): reject private-looking benchmark units
seonghobae
committed
142499d
test(perf): reject private units at comparator boundary
seonghobae
committed
7248c18
fix(perf): constrain benchmark measurement units
seonghobae
committed
92eaeb1
fix(perf): validate comparator measurement units
seonghobae
committed
3fe89a3
test(perf): require markdown measurement harness
seonghobae
committed
3e1f345
feat(perf): add bounded markdown runtime measurement
seonghobae
committed
124e944
test(perf): bind markdown measurements to measured artifact
seonghobae
committed
a08eb09
test(perf): use exact measured module digests
seonghobae
committed
e29e569
fix(perf): verify measured markdown artifact provenance
seonghobae
committed
866ca00
test(perf): reject measurement output aliasing module
seonghobae
committed
1ecdba3
fix(perf): preserve measured module from output writes
seonghobae
committed
b5373c9
test(perf): reject non-local file URL authorities
seonghobae
committed
4fb4f3f
fix(perf): require local file URL authority
seonghobae
committed
2bcd1de
test(perf): redact measured module failures
seonghobae
committed
398c16b
fix(perf): redact measured module failures
seonghobae
committed
8369d42
test(perf): require deterministic demo chunking
seonghobae
committed
df31a76
feat(perf): classify demo vendor chunks
seonghobae
committed
0ec9731
fix(perf): split oversized demo bundle
seonghobae
committed
490795b
test(perf): require revision-evidence measurement harness
seonghobae
committed
84aab25
feat(perf): measure packed revision-evidence latency
seonghobae
committed
1f64915
test(perf): reject symlinked summary inputs
seonghobae
committed
407b8a1
fix(perf): reject symlinked summary evidence
seonghobae
committed
5882974
test(perf): redact hostile revision result accessors
seonghobae
committed
24d05fd
fix(perf): contain hostile revision result accessors
seonghobae
committed
10b071d
test(perf): define retained-memory settling RED contract
seonghobae
committed
286bc07
feat(perf): analyze retained-memory settling
seonghobae
committed
ef33eba
test(perf): reject mismatched memory evidence profiles
seonghobae
committed
e4cab92
fix(perf): bind memory benchmark id to profile
seonghobae
committed
e671a5a

Commits on Aug 23, 2026

test(perf): reject inexact memory medians
seonghobae
committed
5a6944c
fix(perf): fail closed on inexact memory medians
seonghobae
committed
a1b5201
test(perf): reject mismatched benchmark profiles
seonghobae
committed
80c8bbb
fix(perf): bind benchmark ids to document profiles
seonghobae
committed
dcf8b65
test(perf): reject mismatched sample profiles
seonghobae
committed
b240eac
fix(perf): bind sample ids to document profiles
seonghobae
committed
00b062e
test(perf): reject corpus output symlink escape
seonghobae
committed
1a76294
fix(perf): protect corpus output paths
seonghobae
committed
abf7d89
test(perf): redact benchmark output path failures
seonghobae
committed
4002bc4
fix(perf): redact benchmark output path failures
seonghobae
committed
1528f0e
test(perf): redact revision output path failures
seonghobae
committed
da69be6
fix(perf): redact revision output path failures
seonghobae
committed
523c986
test(perf): redact summary output preparation failures
seonghobae
committed
28a45ac
fix(perf): redact output directory preparation failures
seonghobae
committed
d44925e
test(perf): redact Markdown output publication failures
seonghobae
committed
d454176
fix(perf): redact Markdown output publication failures
seonghobae
committed
e066321
test(perf): redact revision output publication failures
seonghobae
committed
0b724e0
fix(perf): redact revision output publication failures
seonghobae
committed
12a48b4
test(perf): require single-command benchmark suite
seonghobae
committed
86a771e
feat(perf): compose single-command benchmark suite
seonghobae
committed
9a618bc
test(perf): reject symlink benchmark output directories
seonghobae
committed
c41f101
fix(perf): reject symlink suite output roots
seonghobae
committed
18fe738
test(perf): reject symlink summary output directory
seonghobae
committed
156b8e3
fix(perf): reject symlink summary directories
seonghobae
committed
52ba733
test(perf): reject symlinked summary ancestors
seonghobae
committed
bd3eb04
fix(perf): reject symlinked summary ancestors
seonghobae
committed
3b722e4
test(perf): reject symlinked suite ancestors
seonghobae
committed
eb15b2f
fix(perf): reject symlinked suite ancestors
seonghobae
committed
0cfd5a9
test(perf): reject symlinked markdown output ancestors
seonghobae
committed
f1adf74
fix(perf): reject symlinked markdown output ancestors
seonghobae
committed
0ac8712
test(perf): reject symlinked revision output ancestors
seonghobae
committed
2bcf06c
fix(perf): reject symlinked revision output ancestors
seonghobae
committed
2e9332e
fix(perf): preserve path-redacted summary failures
seonghobae
committed
ea00fe9
test(perf): reject symlinked sample input
seonghobae
committed
dba7505
fix(perf): reject symlinked summary sample input
seonghobae
committed
9afff91
fix(perf): preserve nonregular input diagnostics
seonghobae
committed
824561c
test(perf): cover markdown input path privacy
seonghobae
committed
a7b6bc9
fix(perf): redact markdown input path errors
seonghobae
committed
dd35f07
test(perf): cover markdown module path privacy
seonghobae
committed
1781400
fix(perf): redact markdown module path errors
seonghobae
committed
17bb601
test(perf): reproduce revision module path leak
seonghobae
committed
2d22587
fix(perf): redact revision module path errors
seonghobae
committed
0547812
test(perf): reproduce revision input path leak
seonghobae
committed
cecef7d
fix(perf): redact revision file-open path errors
seonghobae
committed
f412c50
test(perf): reproduce existing-output alias path leaks
seonghobae
committed
df1ac90
fix(perf): validate Markdown input before alias stat
seonghobae
committed
9488aad
fix(perf): validate revision input before alias stat
seonghobae
committed
d2a7a1f
test(perf): reproduce summary input path leak
seonghobae
committed
82155d3
fix(perf): redact summary input inspection failures
seonghobae
committed
463f100
test(perf): expose retained-memory input path leakage
seonghobae
committed
f4400a6
fix(perf): redact retained-memory input inspection failures
seonghobae
committed
5d1a62e
test(perf): expose comparator input path leakage
seonghobae
committed
6a6ee59
fix(perf): redact comparator input inspection failures
seonghobae
committed
00bdb5b
test(perf): expose Office fixture output symlink overwrite
seonghobae
committed
45c6f41
fix(perf): fail closed on Office fixture output symlinks
seonghobae
committed
e4d3478
test(perf): expose Office fixture output directory symlinks
seonghobae
committed
5fe6023
fix(perf): reject Office fixture output directory symlinks
seonghobae
committed
7983e66
test(perf): reject hard-linked Office fixture outputs
seonghobae
committed
31dee74
fix(perf): reject hard-linked Office fixture outputs
seonghobae
committed
233f81e

Commits on Aug 24, 2026

test(perf): expose summary output hard-link overwrite
seonghobae
committed
cdd9e34
fix(perf): reject hard-linked summary outputs
seonghobae
committed
36d8830
chore(perf): preserve summary metadata formatting
seonghobae
committed
2222364
fix(perf): preserve summary alias diagnostics
seonghobae
committed
3ddee5a
test(perf): expose producer output hard-link overwrite
seonghobae
committed
399a67a
fix(perf): reject hard-linked Markdown output
seonghobae
committed
1b7da55
fix(perf): reject hard-linked revision output
seonghobae
committed
a48c1d4
test(perf): require revision evidence in single-command suite
seonghobae
committed
2f94a6b
feat(perf): compose revision evidence in current benchmark suite
seonghobae
committed
49baff6
fix(perf): preserve measured-script argument order
seonghobae
committed
2614a79
test(perf): keep suite symlink regression on current CLI
seonghobae
committed
7ae8007
test(perf): require atomic suite evidence publication
seonghobae
committed
eb6e8ac
fix(perf): remove partial suite evidence on failure
seonghobae
committed
0af333b
test(perf): require packed artifact benchmark provenance
seonghobae
committed
d609faa
fix(perf): bind suite to packed npm artifact
seonghobae
committed
a49ea9d
test(perf): reject mislabeled benchmark runtime provenance
seonghobae
committed
f0c9d8f
fix(perf): attest active benchmark runtime
seonghobae
committed
0c9f3f3
test(perf): bind suite manifest to run provenance
seonghobae
committed
5c8f6f8
fix(perf): bind suite manifest to run provenance
seonghobae
committed
946c715

Commits on Aug 25, 2026

test(perf): attest packed suite run provenance
seonghobae
committed
413b0f3
test(perf): bind benchmark source provenance to checkout
seonghobae
committed
f136388
fix(perf): verify benchmark source checkout provenance
seonghobae
committed
9876531
fix(perf): reject dirty benchmark provenance
seonghobae
committed
4a9661f
test(perf): isolate checkout provenance regression
seonghobae
committed
b376877
test(perf): require Office duration and RSS evidence
seonghobae
committed
8b7b6df
test(perf): bind Office evidence to canonical fixtures
seonghobae
committed
38a287c
feat(perf): measure canonical Office render latency and RSS
seonghobae
committed
a5275f9
test(perf): bound hung Office render sample RED
seonghobae
committed
e6598e8
fix(perf): bound Office render sample duration
seonghobae
committed
7128b6c
test(perf): require child fixture re-verification
seonghobae
committed
1572af1
fix(perf): bind Office child to canonical fixture
seonghobae
committed
28053fd
test(perf): pass canonical child identity
seonghobae
committed
a6ab00f
test(perf): bind packed benchmark to verified tarball bytes
seonghobae
committed
2251be8
test(perf): exercise packed tarball interposition
seonghobae
committed
0055f24
fix(perf): snapshot verified packed artifact before extraction
seonghobae
committed
4033e2c
fix(test): preserve generated benchmark source interpolation
seonghobae
committed
c455ec1
test(perf): reject mutable existing suite evidence targets
seonghobae
committed
5abc237
fix(perf): preserve existing benchmark evidence directories
seonghobae
committed
9621133
test(perf): cover core existing-output race boundary
seonghobae
committed
1949f18
fix(perf): fail closed on existing evidence output
seonghobae
committed
92683c2
test(perf): preserve existing measurement evidence
seonghobae
committed
c16fe9c
fix(perf): preserve existing markdown evidence
seonghobae
committed
856c1e9
fix(perf): preserve existing revision evidence
seonghobae
committed
1b7710a
test(perf): require HTML serialization measurement
seonghobae
committed
71b1fc5
feat(perf): measure HTML serialization direction
seonghobae
committed
8851d5d
test(perf): require HTML serialization in benchmark suite
seonghobae
committed
cf8fd2e
feat(perf): include HTML serialization in suite
seonghobae
committed
94ad4f8
test(perf): require packed HTML serialization evidence
seonghobae
committed
0d8557d
test(perf): reject mismatched benchmark source checkout
seonghobae
committed
c220538
fix(perf): bind benchmark evidence to checked-out source
seonghobae
committed
67b499c
test(perf): bind suite source provenance to checkout
seonghobae
committed
fd73da7
test(perf): use live checkout SHA for HTML suite
seonghobae
committed
5547e4d
fix(perf): reject wrong source SHA before benchmark evidence
seonghobae
committed
aa9be79
fix(perf): restore packed HTML benchmark composition
seonghobae
committed
0001bb9

Commits on Aug 26, 2026

test(perf): reject false producer provenance
seonghobae
committed
48363ba
fix(perf): bind Markdown evidence to live source
seonghobae
committed
a83a425
fix(perf): bind revision evidence to live source
seonghobae
committed
d4e7883
fix(test): preserve producer provenance typing
seonghobae
committed
19c8c28
fix(test): use live Markdown benchmark provenance
seonghobae
committed
fa91c06
fix(test): use live revision benchmark provenance
seonghobae
committed
d46dc2f
fix(test): use active suite runtime provenance
seonghobae
committed
c3d9fa6
fix(test): bind producer immutability fixtures to active provenance
seonghobae
committed
65cb302
fix(test): bind Markdown privacy fixtures to active provenance
seonghobae
committed
8f1480a
fix(test): bind HTML serialization fixtures to active provenance
seonghobae
committed
aba2d3b
fix(test): bind HTML suite runtime to active provenance
seonghobae
committed
d334b95
test(perf): reject source movement during Office measurement
seonghobae
committed
fc54c8c
fix(perf): bind Office evidence to stable source revision
seonghobae
committed
227418d
test(perf): reject source movement during direct measurement
seonghobae
committed
483c3fc
test(perf): build isolated git shim for source-move RED
seonghobae
committed
65e6327
fix(perf): recheck source provenance after markdown measurement
seonghobae
committed
8a7e49c
fix(perf): recheck source provenance after revision measurement
seonghobae
committed
a5123c7

Commits on Aug 28, 2026

test(perf): reject symlinked corpus output directory
seonghobae
committed
0fc19a7
fix(perf): reject unsafe corpus directory ancestry
seonghobae
committed
30edf11
test(perf): keep benchmark contracts portable on Node 24
seonghobae
committed
b5ad1da
test(perf): allow slow benchmark contract processes
seonghobae
committed
d025d45
test(perf): define autosave enqueue measurement contract
seonghobae
committed
97514db
fix(perf): implement autosave enqueue measurement
seonghobae
committed
690c039
test(perf): require bounded PR benchmark evidence workflow
seonghobae
committed
8fc0ba4
ci(perf): add bounded exact-head smoke evidence
seonghobae
committed
55a56bc
test(perf): bind smoke revision input to envelope schema
seonghobae
committed
0ad9366
fix(perf): benchmark a valid document envelope
seonghobae
committed
a5b741b

Commits on Aug 29, 2026

test(perf): require packed autosave suite evidence
seonghobae
committed
2d3acdd
feat(perf): include autosave in packed benchmark suite
seonghobae
committed
4cb6c49
test(perf): require canonical autosave sample schema
seonghobae
committed
4a68ae3
fix(perf): standardize autosave benchmark evidence
seonghobae
committed
36ba0fa
test(perf): require hosted HTML serialization evidence
seonghobae
committed
b3a1aff
ci(perf): smoke HTML serialization evidence
seonghobae
committed
f88ba74
fix(perf): keep path-stability fixture current with packed suite
seonghobae
committed
e6659b2

Commits on Sep 4, 2026

Merge remote-tracking branch 'origin/main' into HEAD
seonghobae
committed
67fdc48
test(perf): canonicalize the macOS temp root
seonghobae
committed
3d5e739
Merge remote-tracking branch 'origin/main' into HEAD
seonghobae
committed
e2cc551
fix(ci): preserve Python boundary coverage
seonghobae
committed
a9804ae
fix(ci): restore full Python PR matrix
seonghobae
committed
d22bcfc
fix(perf): bind revision evidence to corpus profiles
seonghobae
committed
8f8cd7d
fix(perf): measure autosave with profile input
seonghobae
committed
b2cf91f
fix(perf): measure autosave with profile input
seonghobae
committed
d0e353a
merge: preserve autosave measurement correction
seonghobae
committed
753775b
fix(perf): scale envelope structure by profile
seonghobae
committed
b434cc8
perf: measure packed transition evidence
seonghobae
committed
466326f
fix(perf): redact transition result inspection
seonghobae
committed
d36227a
perf: measure autosave coalescing
seonghobae
committed
f7da6b3
perf: measure autosave commit classification
seonghobae
committed
e22141c
perf: measure envelope canonicalization
seonghobae
committed
f6875f4
fix(perf): scale HTML benchmark corpus
seonghobae
committed
8402073
fix(perf): bind packed evidence to corpus
seonghobae
committed
c05ca75
test(perf): use locked packed corpus
seonghobae
committed
50f0bff
ci(perf): add full profile evidence matrix
seonghobae
committed
d978083
test(perf): require repository-scoped concurrency
seonghobae
committed
699808e
fix(perf): scope concurrency to repository
seonghobae
committed
5701b7e
experiment: reuse canonical UTF-8 encoder
seonghobae
committed
9258bdb

Commits on Sep 5, 2026

Commits on Sep 6, 2026