Skip to content

Commit 6d7c60b

Browse files
V40 Gate 2: Add test inventory coverage matrix
Adds the package-backed V40 test inventory coverage matrix, deterministic generated artifact, generator and gate check scripts, protocol exports, focused package tests, workflow wiring, and spec/roadmap documentation for Gate 2 closure. Preserves the V41 prompts-as-programs boundary while advancing V40 to Gate 3.
1 parent 30de96a commit 6d7c60b

18 files changed

Lines changed: 1247 additions & 7 deletions

.bitcode/v40-test-inventory-coverage-matrix.json

Lines changed: 538 additions & 0 deletions
Large diffs are not rendered by default.

.github/workflows/bitcode-canon-quality.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -223,6 +223,9 @@ jobs:
223223
if [ -f BITCODE_SPEC_V40.md ]; then
224224
node scripts/check-bitcode-spec-family.mjs --version V40 --mode draft --current-target V39
225225
node scripts/check-v40-gate1-testing-roadmap-opening.mjs --skip-branch-check
226+
if [ -f scripts/check-v40-gate2-test-inventory-coverage-matrix.mjs ]; then
227+
node scripts/check-v40-gate2-test-inventory-coverage-matrix.mjs --skip-branch-check --skip-package-tests
228+
fi
226229
fi
227230
else
228231
echo "Unexpected BITCODE_SPEC.txt pointer: $POINTER" >&2

.github/workflows/bitcode-gate-quality.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -352,6 +352,9 @@ jobs:
352352
if [ -f BITCODE_SPEC_V40.md ]; then
353353
node scripts/check-bitcode-spec-family.mjs --version V40 --mode draft --current-target V39
354354
node scripts/check-v40-gate1-testing-roadmap-opening.mjs --skip-branch-check
355+
if [ -f scripts/check-v40-gate2-test-inventory-coverage-matrix.mjs ]; then
356+
node scripts/check-v40-gate2-test-inventory-coverage-matrix.mjs --skip-branch-check --skip-package-tests
357+
fi
355358
fi
356359
else
357360
echo "Unexpected BITCODE_SPEC.txt pointer: $POINTER" >&2

BITCODE_SPEC_V40.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
- Prior canonical anchor: `BITCODE_SPEC_V39.md`
1010
- Prior generated proof appendix: `BITCODE_SPEC_V39_PROVEN.md`
1111
- Active canonical pointer during draft opening: `BITCODE_SPEC.txt` -> `V39`
12-
- Generated structured artifact inventory: draft `.bitcode/v40-spec-family-report.json` and `.bitcode/v40-canonical-input-report.json` plus later V40 gate artifacts for E2E, visual, integration, unit, proof, and promotion readiness coverage
12+
- Generated structured artifact inventory: draft `.bitcode/v40-spec-family-report.json`, `.bitcode/v40-canonical-input-report.json`, `.bitcode/v40-test-inventory-coverage-matrix.json`, plus later V40 gate artifacts for E2E, visual, integration, unit, proof, and promotion readiness coverage
1313
- Source parity state: V40 opens testing-system specification over active V39; package, API, pipeline, conversation, Terminal, Auxillaries, Exchange, interface, ledger/database/storage, and demonstration tests remain to be hardened gate by gate
1414
- Notes companion: `BITCODE_SPEC_V40_NOTES.md`
1515
- Delta companion: `BITCODE_SPEC_V40_DELTA.md`
@@ -99,6 +99,13 @@ Testing domain objects add scenario matrices, fixture manifests, replay transcri
9999
The V40 operator chain is: author a scenario, seed source-safe fixtures, run unit tests, run integration tests, run browser and visual tests, run route/API tests, run pipeline and conversation tests, run ledger/database/storage synchronization tests, run local/staging rehearsal, inspect generated artifacts, repair failures, and only then promote canon.
100100
Every chain step must produce a deterministic or explicitly lane-bound receipt.
101101

102+
## V40 Gate 2 Test Inventory And Coverage Matrix
103+
104+
Gate 2 makes the testing scope auditable before V40 closes deeper test implementation.
105+
The package-owned `V40TestInventoryCoverageMatrix` emits `.bitcode/v40-test-inventory-coverage-matrix.json` with ten source-safe surfaces: unit coverage, API and route integration, Reading pipeline integration, Conversation and Terminal integration, browser/visual/accessibility/responsive proof, ledger/database/storage/wallet/delivery synchronization, local/staging rehearsal, prompt benchmark smoke, demonstration parity, and gate/canon promotion quality.
106+
Rows record owners, commands, source roots, generated artifact targets, coverage tier, and the later V40 gate responsible for closure.
107+
The artifact may name test paths, command ids, and source-safe metadata, but must not include secrets, protected source, raw protected prompts, raw provider responses, wallet private material, or unpaid AssetPack source.
108+
102109
## V40 canonical subsystem surfaces
103110

104111
### Depositing and asset supply
@@ -357,6 +364,7 @@ V40 inherits operator-quality artifact expectations for readable proof and repai
357364
| --- | --- | --- |
358365
| `.bitcode/v40-spec-family-report.json` | protocol canonical package | draft spec family validation |
359366
| `.bitcode/v40-canonical-input-report.json` | protocol canonical package | draft canonical input accounting |
367+
| `.bitcode/v40-test-inventory-coverage-matrix.json` | protocol canonical package | Gate 2 source-safe test inventory and coverage matrix |
360368
| `.bitcode/v40-promotion-readiness-report.json` | future V40 promotion gate | promotion readiness |
361369

362370
### V40 specifying generated artifacts

BITCODE_SPEC_V40_DELTA.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,7 @@ Open the V40 spec family, roadmap, branch posture, workflow posture, checker, an
3333
### Gate 2: Test Inventory And Coverage Matrix
3434

3535
Inventory existing tests, missing critical surfaces, owners, commands, fixtures, and generated artifacts.
36+
Gate 2 closes with package-backed `V40TestInventoryCoverageMatrix`, deterministic `.bitcode/v40-test-inventory-coverage-matrix.json`, protocol exports, source-safe rows for every planned V40 testing surface, and `check:v40-gate2`.
3637

3738
### Gate 3: Unit Coverage For Packages And Primitives
3839

BITCODE_SPEC_V40_NOTES.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,9 @@ V40 must cover:
4343

4444
V41 should focus on Prompt and PromptPart implementation.
4545
Every raw PromptPart and composed Prompt should be examined, benchmarked, semantically repartitioned where useful, retitled where useful, rewritten where benchmark evidence supports it, catalogued, and tied to inference callsites.
46+
V41 treats prompts as programs: every prompt part, composition, interpolation binding, registry edge, benchmark fixture, and inference consumer must be precise enough to review, test, compare, and improve deliberately.
47+
The primary V41 hardening surface is the Reading inference system, including `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis`; conversational interactions and other inference points must receive the same prompt-catalogue treatment after the Reading spine is accounted.
48+
V38's inference correctness hardening provides the call-stack scaffolding, and V40's benchmark/test work provides the measurement base that makes V41 prompt rewrites auditable instead of stylistic.
4649
V40 should make those benchmarks runnable and trustworthy, not consume the prompt-rewrite scope.
4750

4851
## Candidate V40 workstreams
@@ -58,3 +61,9 @@ V40 should make those benchmarks runnable and trustworthy, not consume the promp
5861
- Gate 9 closes local and staging-testnet rehearsals.
5962
- Gate 10 closes prompt benchmark smoke and V41 readiness.
6063
- Gate 11 closes promotion readiness.
64+
65+
## Gate 2 implementation notes
66+
67+
Gate 2 is closed by `V40TestInventoryCoverageMatrix`.
68+
Its generated `.bitcode/v40-test-inventory-coverage-matrix.json` artifact names every major V40 testing surface, owner gate, source roots, command ids, generated artifact target, coverage tier, and missing-coverage closure gate.
69+
This is an inventory and planning proof, not a substitute for the later Gate 3 through Gate 10 implementations.

BITCODE_SPEC_V40_PARITY_MATRIX.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
4242
| Area | Closure requirement | Judgment |
4343
| --- | --- | --- |
4444
| Gate 1 | Open V40 family and check script | drafted |
45-
| Gate 2 | Test inventory artifact and coverage matrix | not yet implemented |
45+
| Gate 2 | Test inventory artifact and coverage matrix | implemented |
4646
| Gate 3 | Unit coverage closure artifact | not yet implemented |
4747
| Gate 4 | API/route integration artifact | not yet implemented |
4848
| Gate 5 | Reading pipeline integration artifact | not yet implemented |
@@ -53,6 +53,8 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
5353
| Gate 10 | Prompt benchmark smoke and V41 readiness artifact | not yet implemented |
5454
| Gate 11 | Promotion readiness artifact and workflow | not yet implemented |
5555

56+
Gate 2 implementation evidence: package-backed `V40TestInventoryCoverageMatrix` emits `.bitcode/v40-test-inventory-coverage-matrix.json` and is wired through `check:v40-gate2`.
57+
5658
## V40 accepted boundaries
5759

5860
V40 may refactor test architecture, fixtures, generated artifacts, workflows, and documentation to make commercial quality greenable.

README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -524,6 +524,12 @@ is wired through `pnpm run check:v39-gate9` and its generated
524524
For V40, Gate 1 opens `version/v40` and the gate-quality posture through
525525
`pnpm run check:v40-gate1` before later gates add generated exhaustive testing
526526
artifacts and the V40 promotion workflow.
527+
V40 Gate 2 adds the package-backed `V40TestInventoryCoverageMatrix`, generated
528+
`.bitcode/v40-test-inventory-coverage-matrix.json`, and `check:v40-gate2` to
529+
inventory unit, API/route, Reading pipeline, Conversation/Terminal,
530+
browser/visual/accessibility/responsive, ledger/database/storage/wallet/delivery,
531+
local/staging, prompt benchmark smoke, demonstration, and CI/promotion testing
532+
surfaces before deeper V40 gates close their implementations.
527533
V38 Gates 1 through 11 are wired through `pnpm run check:v38-gate1`,
528534
`pnpm run check:v38-gate2`, `pnpm run check:v38-gate3`,
529535
`pnpm run check:v38-gate4`, `pnpm run check:v38-gate5`,

SPECIFICATIONS_ROADMAP.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,15 +5,16 @@
55
- Current active canonical pointer: `BITCODE_SPEC.txt` -> `V39`
66
- Current active canon: `BITCODE_SPEC_V39.md`
77
- Current draft target: `BITCODE_SPEC_V40.md`.
8-
- Current working gate: V40 Gate 1 Exhaustive Testing Roadmap And Spec Opening.
9-
- Next queued gate after V40 Gate 1 closure: V40 Gate 2 Test Inventory And Coverage Matrix.
8+
- Current working gate: V40 Gate 2 Test Inventory And Coverage Matrix.
9+
- Next queued gate after V40 Gate 2 closure: V40 Gate 3 Unit Coverage For Packages And Primitives.
1010
- Latest closed version: V39 Commercial Reading Readiness, which promoted Depository supply indexing, enterprise five-step Reading UX, ReadNeed review/resynthesis, ReadFitsFinding many-candidate runtime, source-safe AssetPack preview and deterministic BTC quote, settlement rights delivery, operational telemetry/repair readback, interface parity, local/staging rehearsal, and V39 promotion readiness.
1111
- Recent V39 closure anchor: V39 canonical promotion updated `BITCODE_SPEC.txt` to `V39`, generated `BITCODE_SPEC_V39_PROVEN.md`, preserved active V39 / draft V40 runtime posture, and closed commercial Reading readiness canon.
1212
- V39 Gate 9 closure anchor: commercial Reading readiness now owns package-backed `ReadingInterfaceProductParity`, deterministic `.bitcode/v39-interface-conversation-product-parity.json`, Terminal/Conversation/API/MCP/ChatGPT/package-consumer no-bypass rows, source-safe contract readback, BTD interface root composition, focused package/interface tests, and workflow wiring through `check:v39-gate9`.
1313
- V39 Gate 10 closure anchor: Reading readiness now owns package-backed `ReadingLocalStagingRehearsal`, deterministic `.bitcode/v39-local-staging-reading-rehearsal.json`, local/staging-testnet lane readback, five-stage Reading stage readback, many-fit Depository search rehearsal, source-safe AssetPack preview, settlement/BTD rights/delivery posture, rich telemetry readback, ledger/database/storage synchronization, value-bearing mainnet blocking, focused package/protocol tests, and workflow wiring through `check:v39-gate10`.
1414
- V39 Gate 11 closure anchor: commercial Reading readiness now owns package-backed `V39CommercialReadingPromotionReadinessReport`, deterministic `.bitcode/v39-promotion-readiness-report.json`, `BITCODE_SPEC_V39_PROVEN.md` generation support, `v39-canon-promotion.yml`, promotion command dry-run support, gate/canon workflow posture, active V39 / draft V40 runtime preparation, all V39 commercial Reading artifacts covered, source-safe, and parseable, and value-bearing mainnet admission blocked through `check:v39-gate11`.
1515
- V40 Gate 1 opening anchor: exhaustive commercial application testing opens over promoted V39 with V40 SPEC, DELTA, NOTES, and PARITY files, `check:v40-gate1`, active V39 / draft V40 posture, and an eleven-gate plan for test inventory, unit coverage, API/route integrations, Reading pipeline integrations, Conversation/Terminal integrations, browser/visual/accessibility/responsive proof, ledger/database/storage/wallet/delivery synchronization, local/staging rehearsal, prompt benchmark smoke, and promotion readiness.
16-
- Forward planning note: V41 should focus singularly on Prompt and PromptPart implementation quality: prompts as programs. V38's inference correctness hardening and V40's testing/benchmark depth should empower V41 to examine every raw PromptPart, every Prompt composition, every benchmark, semantic partition, title, template, interpolation contract, registry binding, and inference callsite; then repartition, retitle, rewrite, catalogue, and validate them across Reading pipelines and conversational interactions.
16+
- V40 Gate 2 closure anchor: exhaustive testing now owns package-backed `V40TestInventoryCoverageMatrix` source, deterministic `.bitcode/v40-test-inventory-coverage-matrix.json`, ten source-safe inventory surfaces covering unit, API/route, Reading pipeline, Conversation/Terminal, browser/visual/accessibility/responsive, ledger/database/storage/wallet/delivery, local/staging, prompt benchmark smoke, demonstration, and CI/promotion quality, protocol exports, package tests, workflow wiring, and `check:v40-gate2`.
17+
- Forward planning note: V41 should focus singularly on Prompt and PromptPart implementation quality: prompts as programs. V38's inference correctness hardening and V40's testing/benchmark depth should empower V41 to examine every raw PromptPart, every Prompt composition, every benchmark, semantic partition, title, template, interpolation contract, registry binding, and inference callsite; then repartition, retitle, rewrite, catalogue, and validate them across Reading pipelines and conversational interactions. V41 should primarily harden `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis` prompt surfaces while also covering conversational and other inference prompts with the same catalogue-and-benchmark discipline.
1718
- V34 Gate 2 closure anchor: deployment-depth now owns package-backed `DeploymentHostCapabilityCatalog` and `EnvironmentLaneContract` source, deterministic `.bitcode/v34-deployment-host-capability-catalog.json` and `.bitcode/v34-environment-lane-contracts.json`, and visible `value-bearing-mainnet` blocking through `blocked_future_canon_required`.
1819
- V34 Gate 3 closure anchor: deployment-depth now owns package-backed `DistributedExecutionRuntimeReceipt` source, deterministic `.bitcode/v34-distributed-execution-runtime-receipts.json`, `request_response_not_required` long-running work posture, and source-safe roots for pipeline, PTRR agent, ThricifiedGeneration, tool, ledger, wallet, proof, object-storage, and repair work.
1920
- V34 Gate 4 closure anchor: deployment-depth now owns package-backed `DeploymentStoragePosture` source, deterministic `.bitcode/v34-deployment-storage-posture.json`, ledger/database/object-storage drift repair fixtures, retention/encryption/backup/rollback/audit posture, and source-bearing AssetPack storage remains locked before settlement.
@@ -133,7 +134,7 @@ They are referenced here for specification history only; active implementation w
133134
| V38 | `BITCODE_SPEC_V38.md` | promoted historical Bitcode canon | Inference correctness after V37: pipeline execution call stack, PTRR agents, FailsafeGenerationSequence over ThricifiedGeneration, prompt registry composition, PromptPart and Prompt benchmarking, Reading pipeline inference, ReadFitsFindingSynthesis depository search and embeddings, source-safe inference telemetry, local/staging rehearsal, and promotion readiness. |
134135
| V39 | `BITCODE_SPEC_V39.md` | active canon | Commercial Reading readiness after V38: Depository supply indexing, enterprise five-step Reading UX, ReadNeed review/resynthesis, ReadFitsFinding many-candidate runtime and replay, source-safe AssetPack preview and deterministic BTC quote, settlement, BTD rights transfer, post-settlement delivery, ledger/database/storage synchronization, operational telemetry/repair, interface parity, local/staging rehearsal, and promotion readiness. |
135136
| V40 | `BITCODE_SPEC_V40.md` | active draft target | Exhaustive commercial application testing depth after V39: rich browser E2E for all website interactions and state possibilities, visual/screenshot comparison coverage, API and integration suites for pipelines, conversations, routes, ledger/database/storage synchronization, and unit coverage for packages, primitives, isolated implementations, and real commercial implementations. |
136-
| V41 | future draft target after V40 | planned | Prompt and PromptPart excellence, treating prompts as programs: audit every raw PromptPart and composed Prompt, run and harden benchmarks, repartition prompts into benchmarkable semantic parts, retitle and rewrite PromptParts/Prompts where optimal, catalogue registry bindings and interpolation contracts, and elevate all Reading and Conversation inference points after V38 inference scaffolding and V40 testing depth make that work measurable. |
137+
| V41 | future draft target after V40 | planned | Prompt and PromptPart excellence, treating prompts as programs: audit every raw PromptPart and composed Prompt, run and harden benchmarks, repartition prompts into benchmarkable semantic parts, retitle and rewrite PromptParts/Prompts where optimal, catalogue registry bindings and interpolation contracts, and elevate all Reading and Conversation inference points after V38 inference scaffolding and V40 testing depth make that work measurable. The primary surface is Reading, especially `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis`; conversations and other inference prompts follow with the same benchmarkable catalogue discipline. |
137138

138139
## Current Planning Spine
139140

package.json

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -246,6 +246,9 @@
246246
"check:v39-promotion-readiness": "node scripts/generate-v39-promotion-readiness-report.mjs --check",
247247
"check:v39-gate11": "node scripts/check-v39-gate11-promotion-readiness.mjs",
248248
"check:v40-gate1": "node scripts/check-v40-gate1-testing-roadmap-opening.mjs",
249+
"generate:v40-test-inventory": "node scripts/generate-v40-test-inventory-coverage-matrix.mjs",
250+
"check:v40-test-inventory": "node scripts/generate-v40-test-inventory-coverage-matrix.mjs --check",
251+
"check:v40-gate2": "node scripts/check-v40-gate2-test-inventory-coverage-matrix.mjs",
249252
"generate:v38-inference-surface-inventory": "node scripts/generate-v38-inference-surface-inventory.mjs",
250253
"check:v38-inference-surface-inventory": "node scripts/generate-v38-inference-surface-inventory.mjs --check",
251254
"check:v38-gate2": "node scripts/check-v38-gate2-inference-surface-inventory.mjs",

0 commit comments

Comments
 (0)