Merge pull request #152 from engineeredsoftware/v40/gate-5-reading-pipeline-integration-coverage

V40 Gate 5: Reading Pipeline Integration Coverage

Author: geraldarthurdavis

.bitcode/v40-reading-pipeline-integration-coverage.json

@@ -232,6 +232,9 @@ jobs:
               if [ -f scripts/check-v40-gate4-api-integration-contracts.mjs ]; then
                 node scripts/check-v40-gate4-api-integration-contracts.mjs --skip-branch-check --skip-integration-tests
               fi
+              if [ -f scripts/check-v40-gate5-reading-pipeline-integration.mjs ]; then
+                node scripts/check-v40-gate5-reading-pipeline-integration.mjs --skip-branch-check --skip-integration-tests
+              fi
             fi
           else
             echo "Unexpected BITCODE_SPEC.txt pointer: $POINTER" >&2

.github/workflows/bitcode-canon-quality.yml

@@ -361,6 +361,9 @@ jobs:
               if [ -f scripts/check-v40-gate4-api-integration-contracts.mjs ]; then
                 node scripts/check-v40-gate4-api-integration-contracts.mjs --skip-branch-check --skip-integration-tests
               fi
+              if [ -f scripts/check-v40-gate5-reading-pipeline-integration.mjs ]; then
+                node scripts/check-v40-gate5-reading-pipeline-integration.mjs --skip-branch-check --skip-integration-tests
+              fi
             fi
           else
             echo "Unexpected BITCODE_SPEC.txt pointer: $POINTER" >&2
@@ -435,7 +438,7 @@ jobs:
           pnpm --dir packages/chatgptapp exec jest --runTestsByPath src/__tests__/chatgpt-action-contract.test.ts src/__tests__/tools.test.ts --runInBand --forceExit
           pnpm --filter @bitcode/pipeline-hosts exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-harness.test.ts --runInBand --forceExit
           pnpm --filter @bitcode/pipeline-hosts exec jest --config jest.config.cjs --runTestsByPath src/__tests__/distributed-execution-runtime-receipt.test.ts --runInBand --forceExit
-          pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/reading-pipeline-observability.test.ts src/__tests__/reading-pipeline-contract.test.ts src/__tests__/v32-reading-pipeline-proof-coverage.test.ts --runInBand --forceExit
+          pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/reading-pipeline-integration-coverage.test.ts src/__tests__/reading-pipeline-observability.test.ts src/__tests__/reading-pipeline-contract.test.ts src/__tests__/v32-reading-pipeline-proof-coverage.test.ts --runInBand --forceExit
           pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-disclosure.test.ts src/__tests__/postprocess.test.ts src/__tests__/read-need.test.ts src/__tests__/read-need-review-resynthesis.test.ts --runInBand --forceExit
           pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-preview-boundary.test.ts --runInBand --forceExit
           pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-settlement-rights-delivery.test.ts --runInBand --forceExit

.github/workflows/bitcode-gate-quality.yml

@@ -9,7 +9,7 @@
 - Prior canonical anchor: `BITCODE_SPEC_V39.md`
 - Prior generated proof appendix: `BITCODE_SPEC_V39_PROVEN.md`
 - Active canonical pointer during draft opening: `BITCODE_SPEC.txt` -> `V39`
-- Generated structured artifact inventory: draft `.bitcode/v40-spec-family-report.json`, `.bitcode/v40-canonical-input-report.json`, `.bitcode/v40-test-inventory-coverage-matrix.json`, `.bitcode/v40-unit-coverage-inventory.json`, plus later V40 gate artifacts for E2E, visual, integration, proof, and promotion readiness coverage
+- Generated structured artifact inventory: draft `.bitcode/v40-spec-family-report.json`, `.bitcode/v40-canonical-input-report.json`, `.bitcode/v40-test-inventory-coverage-matrix.json`, `.bitcode/v40-unit-coverage-inventory.json`, `.bitcode/v40-api-integration-contracts.json`, `.bitcode/v40-reading-pipeline-integration-coverage.json`, plus later V40 gate artifacts for E2E, visual, synchronization, rehearsal, proof, and promotion readiness coverage
 - Source parity state: V40 opens testing-system specification over active V39; package, API, pipeline, conversation, Terminal, Auxillaries, Exchange, interface, ledger/database/storage, and demonstration tests remain to be hardened gate by gate
 - Notes companion: `BITCODE_SPEC_V40_NOTES.md`
 - Delta companion: `BITCODE_SPEC_V40_DELTA.md`
@@ -26,6 +26,7 @@ The version must cover real user interactions, state possibilities, accessible U
 
 V40 also prepares V41 by making prompt and PromptPart benchmarks measurable in ordinary quality flows.
 V41 remains the singular prompts-as-programs version after V40, focused on every raw PromptPart, composed Prompt, benchmark, semantic division, title, template, interpolation contract, registry binding, and inference callsite.
+That version must examine, benchmark, re-divide into meaningfully benchmarkable semantic parts, retitle, rewrite, catalogue, and validate prompts as executable inference programs across Reading first and conversational or other inference surfaces next.
 
 ## Canonical Bitcode executive summary
 
@@ -120,6 +121,14 @@ The package-owned `V40ApiIntegrationContracts` emits `.bitcode/v40-api-integrati
 Rows bind route families, source roots, test paths, command ids, verdicts, and closure requirements.
 Gate 4 permits no missing, blocked, or exempt critical contract row; the artifact must prove route contract coverage while withholding secrets, protected source, raw protected prompts, raw provider responses, wallet private material, and unpaid AssetPack source.
 
+## V40 Gate 5 Reading Pipeline Integration Coverage
+
+Gate 5 closes integration coverage for the real Reading pipeline spine without rewriting prompt content.
+The package-owned `V40ReadingPipelineIntegrationCoverage` emits `.bitcode/v40-reading-pipeline-integration-coverage.json` with nine source-safe rows: pipeline contract topology, `ReadNeedComprehensionSynthesis` runtime, `ReadFitsFindingSynthesis` Depository search runtime, PTRR agent implementation integration, AssetPack preview/settlement/delivery boundaries, telemetry/repair readback, Terminal API harness integration, primitive/host integration, and local/staging rehearsal linkage.
+The artifact binds the currently expected Reading topology of two pipelines, five UX steps, eleven phases, twelve PTRR agents, forty-eight PTRR steps, twenty model-structured PTRR steps, one hundred forty-four ThricifiedGeneration records, and four tool surfaces.
+The focused integration test runs the deterministic commercial Reading spine from accepted Need synthesis through many-fit Depository search, source-safe AssetPack preview, settlement/right-transfer delivery boundary, and source-safe observability coverage.
+Gate 5 permits no missing, blocked, or exempt critical Reading integration row; proof rows may include topology, command ids, fixture roots, and coverage flags, but must not include secrets, raw protected prompts, raw provider responses, protected source payloads, or unpaid AssetPack source.
+
 ## V40 canonical subsystem surfaces
 
 ### Depositing and asset supply
@@ -208,7 +217,7 @@ Current accepted boundaries: proof artifacts may summarize sensitive facts but c
 
 | proofFamily | proofArtifactPath | memberIds | theoremIds | replayStepIds | witnessArtifactPaths | Current source basis |
 | --- | --- | --- | --- | --- | --- | --- |
-| Inference-synthesis | `.bitcode/v40-pipeline-integration-coverage.json` | pipeline, agent, step | inference-stack-covered | run-reading-pipeline-tests | prompt receipts, generation receipts | packages/pipelines, packages/agent-generics |
+| Inference-synthesis | `.bitcode/v40-reading-pipeline-integration-coverage.json` | pipeline, agent, step | inference-stack-covered | run-reading-pipeline-tests | prompt receipts, generation receipts | packages/pipelines, packages/agent-generics |
 | Prompt-completeness | `.bitcode/v40-prompt-benchmark-smoke.json` | PromptParts, Prompts | prompt-benchmark-runnable | run-prompt-benchmark-smoke | benchmark receipts | packages/prompts |
 | Static-code-analysis | `.bitcode/v40-unit-coverage-inventory.json` | source packages | source-units-covered | run-unit-suites | coverage maps | packages, uapi |
 | Verification-decisions | `.bitcode/v40-api-integration-contracts.json` | routes, contracts | route-contracts-covered | run-api-integration | API receipts | uapi, packages/api |

BITCODE_SPEC_V40.md

@@ -48,6 +48,7 @@ Gate 4 closes with package-backed `V40ApiIntegrationContracts`, deterministic `.
 ### Gate 5: Reading Pipeline Integration Coverage
 
 Close primitive and real implementation coverage for `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis`.
+Gate 5 closes with package-backed `V40ReadingPipelineIntegrationCoverage`, deterministic `.bitcode/v40-reading-pipeline-integration-coverage.json`, protocol exports, source-safe rows for real Reading pipeline topology/runtime/search/agent/boundary/telemetry/harness/primitive/rehearsal integration, and `check:v40-gate5`.
 
 ### Gate 6: Conversation And Terminal Integration Coverage
 
@@ -75,7 +76,7 @@ Bind all V40 artifacts, proof generation, workflows, and promotion commands into
 
 ## Explicitly deferred
 
-- Prompt and PromptPart semantic rewriting, repartitioning, retitling, and excellence auditing are deferred to V41.
+- Prompt and PromptPart semantic rewriting, repartitioning, retitling, catalogue refactoring, benchmark-driven improvement, and excellence auditing are deferred to V41.
 - New commercial product features are deferred unless needed to make tests truthful.
 - Production-mainnet value-bearing tests remain opt-in until a later promotion mandates them.
 

BITCODE_SPEC_V40_DELTA.md

@@ -47,6 +47,7 @@ V41 treats prompts as programs: every prompt part, composition, interpolation bi
 The primary V41 hardening surface is the Reading inference system, including `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis`; conversational interactions and other inference points must receive the same prompt-catalogue treatment after the Reading spine is accounted.
 V38's inference correctness hardening provides the call-stack scaffolding, and V40's benchmark/test work provides the measurement base that makes V41 prompt rewrites auditable instead of stylistic.
 V40 should make those benchmarks runnable and trustworthy, not consume the prompt-rewrite scope.
+V41 must therefore treat prompt improvement as implementation work, not copy editing: raw PromptParts, composed Prompts, prompt registry edges, interpolation variables, benchmark fixtures, benchmark outputs, and downstream parsed return types are all part of the program surface.
 
 ## Candidate V40 workstreams
 
@@ -81,3 +82,11 @@ Gate 4 is closed by `V40ApiIntegrationContracts`.
 Its generated `.bitcode/v40-api-integration-contracts.json` artifact binds critical API route integration contracts to route families, source roots, test paths, command ids, and covered verdicts.
 The covered surfaces include UAPI Reading/pipeline routes, execution stream routes, Conversation routes, Auxillaries/Orbitals routes, VCS/wallet/webhook routes, public activity/template routes, package API route orchestration, package API Conversation/pipeline routes, MCP execution interface contracts, and ChatGPT App action contracts.
 No missing, blocked, or exempt critical API route integration contract surface is allowed in the Gate 4 artifact.
+
+## Gate 5 implementation notes
+
+Gate 5 is closed by `V40ReadingPipelineIntegrationCoverage`.
+Its generated `.bitcode/v40-reading-pipeline-integration-coverage.json` artifact binds Reading pipeline integration coverage to nine source-safe rows: pipeline contract topology, `ReadNeedComprehensionSynthesis` runtime, `ReadFitsFindingSynthesis` search runtime, PTRR agent implementation integration, preview/settlement/delivery boundaries, telemetry/repair readback, Terminal API harness integration, primitive/host integration, and local/staging rehearsal integration.
+The focused asset-pack package test runs a deterministic Reading path through accepted Need synthesis, many-fit Depository search, `worthy_fit` runtime evidence, source-safe AssetPack preview, settlement/right-transfer delivery boundary, and source-safe observability coverage.
+The artifact records expected totals of two Reading pipelines, eleven phases, twelve PTRR agents, forty-eight PTRR steps, one hundred forty-four ThricifiedGeneration records, and four tool surfaces.
+No missing, blocked, or exempt critical Reading integration row is allowed in the Gate 5 artifact, and prompt content rewriting remains deferred to V41.

BITCODE_SPEC_V40_NOTES.md

@@ -33,8 +33,8 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
 | Browser E2E | Critical website flows have browser proof | future V40 artifacts | not yet implemented |
 | Visual proof | Screenshot comparisons are deterministic and reviewable | future V40 artifacts | not yet implemented |
 | API integration | Route and API contracts are parseable and source-safe | `.bitcode/v40-api-integration-contracts.json` | implemented |
-| Pipeline integration | Primitive and real Reading pipeline implementations are tested | future V40 artifacts | not yet implemented |
-| Unit coverage | Packages, primitives, isolated implementations, and real implementations have unit coverage | future V40 artifacts | not yet implemented |
+| Pipeline integration | Primitive and real Reading pipeline implementations are tested | `.bitcode/v40-reading-pipeline-integration-coverage.json` | implemented |
+| Unit coverage | Packages, primitives, isolated implementations, and real implementations have unit coverage | `.bitcode/v40-unit-coverage-inventory.json` | implemented |
 | Prompt benchmark smoke | Prompt and PromptPart benchmarks run before V41 | future V40 artifacts | not yet implemented |
 
 ## V40 implementation checklist
@@ -45,7 +45,7 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
 | Gate 2 | Test inventory artifact and coverage matrix | implemented |
 | Gate 3 | Unit coverage closure artifact | implemented |
 | Gate 4 | API/route integration artifact | implemented |
-| Gate 5 | Reading pipeline integration artifact | not yet implemented |
+| Gate 5 | Reading pipeline integration artifact | implemented |
 | Gate 6 | Conversation/Terminal integration artifact | not yet implemented |
 | Gate 7 | Browser/visual/accessibility/responsive artifact | not yet implemented |
 | Gate 8 | Ledger/database/storage/wallet/delivery sync artifact | not yet implemented |
@@ -56,6 +56,7 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
 Gate 2 implementation evidence: package-backed `V40TestInventoryCoverageMatrix` emits `.bitcode/v40-test-inventory-coverage-matrix.json` and is wired through `check:v40-gate2`.
 Gate 3 implementation evidence: package-backed `V40UnitCoverageInventory` emits `.bitcode/v40-unit-coverage-inventory.json` and is wired through `check:v40-gate3`.
 Gate 4 implementation evidence: package-backed `V40ApiIntegrationContracts` emits `.bitcode/v40-api-integration-contracts.json` and is wired through `check:v40-gate4`.
+Gate 5 implementation evidence: package-backed `V40ReadingPipelineIntegrationCoverage` emits `.bitcode/v40-reading-pipeline-integration-coverage.json` and is wired through `check:v40-gate5`.
 
 ## V40 accepted boundaries
 

BITCODE_SPEC_V40_PARITY_MATRIX.md

@@ -539,6 +539,13 @@ V40 Gate 4 adds the package-backed `V40ApiIntegrationContracts`, generated
 source-safe API, UAPI, MCP, ChatGPT App, persistence, authorization, and
 response-schema route integration contract coverage before later browser and
 pipeline gates.
+V40 Gate 5 adds the package-backed `V40ReadingPipelineIntegrationCoverage`,
+generated `.bitcode/v40-reading-pipeline-integration-coverage.json`, and
+`check:v40-gate5` to close source-safe integration coverage for
+`ReadNeedComprehensionSynthesis`, `ReadFitsFindingSynthesis`, many-fit
+Depository search, PTRR agent wiring, AssetPack preview/settlement/delivery,
+telemetry/readback, Terminal harnesses, pipeline primitives, hosts, and local
+staging rehearsal linkage.
 V38 Gates 1 through 11 are wired through `pnpm run check:v38-gate1`,
 `pnpm run check:v38-gate2`, `pnpm run check:v38-gate3`,
 `pnpm run check:v38-gate4`, `pnpm run check:v38-gate5`,