Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
901 changes: 901 additions & 0 deletions .bitcode/v40-reading-pipeline-integration-coverage.json

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions .github/workflows/bitcode-canon-quality.yml
Original file line number Diff line number Diff line change
Expand Up @@ -232,6 +232,9 @@ jobs:
if [ -f scripts/check-v40-gate4-api-integration-contracts.mjs ]; then
node scripts/check-v40-gate4-api-integration-contracts.mjs --skip-branch-check --skip-integration-tests
fi
if [ -f scripts/check-v40-gate5-reading-pipeline-integration.mjs ]; then
node scripts/check-v40-gate5-reading-pipeline-integration.mjs --skip-branch-check --skip-integration-tests
fi
fi
else
echo "Unexpected BITCODE_SPEC.txt pointer: $POINTER" >&2
Expand Down
5 changes: 4 additions & 1 deletion .github/workflows/bitcode-gate-quality.yml
Original file line number Diff line number Diff line change
Expand Up @@ -361,6 +361,9 @@ jobs:
if [ -f scripts/check-v40-gate4-api-integration-contracts.mjs ]; then
node scripts/check-v40-gate4-api-integration-contracts.mjs --skip-branch-check --skip-integration-tests
fi
if [ -f scripts/check-v40-gate5-reading-pipeline-integration.mjs ]; then
node scripts/check-v40-gate5-reading-pipeline-integration.mjs --skip-branch-check --skip-integration-tests
fi
fi
else
echo "Unexpected BITCODE_SPEC.txt pointer: $POINTER" >&2
Expand Down Expand Up @@ -435,7 +438,7 @@ jobs:
pnpm --dir packages/chatgptapp exec jest --runTestsByPath src/__tests__/chatgpt-action-contract.test.ts src/__tests__/tools.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-hosts exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-harness.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-hosts exec jest --config jest.config.cjs --runTestsByPath src/__tests__/distributed-execution-runtime-receipt.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/reading-pipeline-observability.test.ts src/__tests__/reading-pipeline-contract.test.ts src/__tests__/v32-reading-pipeline-proof-coverage.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/reading-pipeline-integration-coverage.test.ts src/__tests__/reading-pipeline-observability.test.ts src/__tests__/reading-pipeline-contract.test.ts src/__tests__/v32-reading-pipeline-proof-coverage.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-disclosure.test.ts src/__tests__/postprocess.test.ts src/__tests__/read-need.test.ts src/__tests__/read-need-review-resynthesis.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-preview-boundary.test.ts --runInBand --forceExit
pnpm --filter @bitcode/pipeline-asset-pack exec jest --config jest.config.cjs --runTestsByPath src/__tests__/asset-pack-settlement-rights-delivery.test.ts --runInBand --forceExit
Expand Down
13 changes: 11 additions & 2 deletions BITCODE_SPEC_V40.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
- Prior canonical anchor: `BITCODE_SPEC_V39.md`
- Prior generated proof appendix: `BITCODE_SPEC_V39_PROVEN.md`
- Active canonical pointer during draft opening: `BITCODE_SPEC.txt` -> `V39`
- Generated structured artifact inventory: draft `.bitcode/v40-spec-family-report.json`, `.bitcode/v40-canonical-input-report.json`, `.bitcode/v40-test-inventory-coverage-matrix.json`, `.bitcode/v40-unit-coverage-inventory.json`, plus later V40 gate artifacts for E2E, visual, integration, proof, and promotion readiness coverage
- Generated structured artifact inventory: draft `.bitcode/v40-spec-family-report.json`, `.bitcode/v40-canonical-input-report.json`, `.bitcode/v40-test-inventory-coverage-matrix.json`, `.bitcode/v40-unit-coverage-inventory.json`, `.bitcode/v40-api-integration-contracts.json`, `.bitcode/v40-reading-pipeline-integration-coverage.json`, plus later V40 gate artifacts for E2E, visual, synchronization, rehearsal, proof, and promotion readiness coverage
- Source parity state: V40 opens testing-system specification over active V39; package, API, pipeline, conversation, Terminal, Auxillaries, Exchange, interface, ledger/database/storage, and demonstration tests remain to be hardened gate by gate
- Notes companion: `BITCODE_SPEC_V40_NOTES.md`
- Delta companion: `BITCODE_SPEC_V40_DELTA.md`
Expand All @@ -26,6 +26,7 @@ The version must cover real user interactions, state possibilities, accessible U

V40 also prepares V41 by making prompt and PromptPart benchmarks measurable in ordinary quality flows.
V41 remains the singular prompts-as-programs version after V40, focused on every raw PromptPart, composed Prompt, benchmark, semantic division, title, template, interpolation contract, registry binding, and inference callsite.
That version must examine, benchmark, re-divide into meaningfully benchmarkable semantic parts, retitle, rewrite, catalogue, and validate prompts as executable inference programs across Reading first and conversational or other inference surfaces next.

## Canonical Bitcode executive summary

Expand Down Expand Up @@ -120,6 +121,14 @@ The package-owned `V40ApiIntegrationContracts` emits `.bitcode/v40-api-integrati
Rows bind route families, source roots, test paths, command ids, verdicts, and closure requirements.
Gate 4 permits no missing, blocked, or exempt critical contract row; the artifact must prove route contract coverage while withholding secrets, protected source, raw protected prompts, raw provider responses, wallet private material, and unpaid AssetPack source.

## V40 Gate 5 Reading Pipeline Integration Coverage

Gate 5 closes integration coverage for the real Reading pipeline spine without rewriting prompt content.
The package-owned `V40ReadingPipelineIntegrationCoverage` emits `.bitcode/v40-reading-pipeline-integration-coverage.json` with nine source-safe rows: pipeline contract topology, `ReadNeedComprehensionSynthesis` runtime, `ReadFitsFindingSynthesis` Depository search runtime, PTRR agent implementation integration, AssetPack preview/settlement/delivery boundaries, telemetry/repair readback, Terminal API harness integration, primitive/host integration, and local/staging rehearsal linkage.
The artifact binds the currently expected Reading topology of two pipelines, five UX steps, eleven phases, twelve PTRR agents, forty-eight PTRR steps, twenty model-structured PTRR steps, one hundred forty-four ThricifiedGeneration records, and four tool surfaces.
The focused integration test runs the deterministic commercial Reading spine from accepted Need synthesis through many-fit Depository search, source-safe AssetPack preview, settlement/right-transfer delivery boundary, and source-safe observability coverage.
Gate 5 permits no missing, blocked, or exempt critical Reading integration row; proof rows may include topology, command ids, fixture roots, and coverage flags, but must not include secrets, raw protected prompts, raw provider responses, protected source payloads, or unpaid AssetPack source.

## V40 canonical subsystem surfaces

### Depositing and asset supply
Expand Down Expand Up @@ -208,7 +217,7 @@ Current accepted boundaries: proof artifacts may summarize sensitive facts but c

| proofFamily | proofArtifactPath | memberIds | theoremIds | replayStepIds | witnessArtifactPaths | Current source basis |
| --- | --- | --- | --- | --- | --- | --- |
| Inference-synthesis | `.bitcode/v40-pipeline-integration-coverage.json` | pipeline, agent, step | inference-stack-covered | run-reading-pipeline-tests | prompt receipts, generation receipts | packages/pipelines, packages/agent-generics |
| Inference-synthesis | `.bitcode/v40-reading-pipeline-integration-coverage.json` | pipeline, agent, step | inference-stack-covered | run-reading-pipeline-tests | prompt receipts, generation receipts | packages/pipelines, packages/agent-generics |
| Prompt-completeness | `.bitcode/v40-prompt-benchmark-smoke.json` | PromptParts, Prompts | prompt-benchmark-runnable | run-prompt-benchmark-smoke | benchmark receipts | packages/prompts |
| Static-code-analysis | `.bitcode/v40-unit-coverage-inventory.json` | source packages | source-units-covered | run-unit-suites | coverage maps | packages, uapi |
| Verification-decisions | `.bitcode/v40-api-integration-contracts.json` | routes, contracts | route-contracts-covered | run-api-integration | API receipts | uapi, packages/api |
Expand Down
3 changes: 2 additions & 1 deletion BITCODE_SPEC_V40_DELTA.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,7 @@ Gate 4 closes with package-backed `V40ApiIntegrationContracts`, deterministic `.
### Gate 5: Reading Pipeline Integration Coverage

Close primitive and real implementation coverage for `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis`.
Gate 5 closes with package-backed `V40ReadingPipelineIntegrationCoverage`, deterministic `.bitcode/v40-reading-pipeline-integration-coverage.json`, protocol exports, source-safe rows for real Reading pipeline topology/runtime/search/agent/boundary/telemetry/harness/primitive/rehearsal integration, and `check:v40-gate5`.

### Gate 6: Conversation And Terminal Integration Coverage

Expand Down Expand Up @@ -75,7 +76,7 @@ Bind all V40 artifacts, proof generation, workflows, and promotion commands into

## Explicitly deferred

- Prompt and PromptPart semantic rewriting, repartitioning, retitling, and excellence auditing are deferred to V41.
- Prompt and PromptPart semantic rewriting, repartitioning, retitling, catalogue refactoring, benchmark-driven improvement, and excellence auditing are deferred to V41.
- New commercial product features are deferred unless needed to make tests truthful.
- Production-mainnet value-bearing tests remain opt-in until a later promotion mandates them.

Expand Down
9 changes: 9 additions & 0 deletions BITCODE_SPEC_V40_NOTES.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,7 @@ V41 treats prompts as programs: every prompt part, composition, interpolation bi
The primary V41 hardening surface is the Reading inference system, including `ReadNeedComprehensionSynthesis` and `ReadFitsFindingSynthesis`; conversational interactions and other inference points must receive the same prompt-catalogue treatment after the Reading spine is accounted.
V38's inference correctness hardening provides the call-stack scaffolding, and V40's benchmark/test work provides the measurement base that makes V41 prompt rewrites auditable instead of stylistic.
V40 should make those benchmarks runnable and trustworthy, not consume the prompt-rewrite scope.
V41 must therefore treat prompt improvement as implementation work, not copy editing: raw PromptParts, composed Prompts, prompt registry edges, interpolation variables, benchmark fixtures, benchmark outputs, and downstream parsed return types are all part of the program surface.

## Candidate V40 workstreams

Expand Down Expand Up @@ -81,3 +82,11 @@ Gate 4 is closed by `V40ApiIntegrationContracts`.
Its generated `.bitcode/v40-api-integration-contracts.json` artifact binds critical API route integration contracts to route families, source roots, test paths, command ids, and covered verdicts.
The covered surfaces include UAPI Reading/pipeline routes, execution stream routes, Conversation routes, Auxillaries/Orbitals routes, VCS/wallet/webhook routes, public activity/template routes, package API route orchestration, package API Conversation/pipeline routes, MCP execution interface contracts, and ChatGPT App action contracts.
No missing, blocked, or exempt critical API route integration contract surface is allowed in the Gate 4 artifact.

## Gate 5 implementation notes

Gate 5 is closed by `V40ReadingPipelineIntegrationCoverage`.
Its generated `.bitcode/v40-reading-pipeline-integration-coverage.json` artifact binds Reading pipeline integration coverage to nine source-safe rows: pipeline contract topology, `ReadNeedComprehensionSynthesis` runtime, `ReadFitsFindingSynthesis` search runtime, PTRR agent implementation integration, preview/settlement/delivery boundaries, telemetry/repair readback, Terminal API harness integration, primitive/host integration, and local/staging rehearsal integration.
The focused asset-pack package test runs a deterministic Reading path through accepted Need synthesis, many-fit Depository search, `worthy_fit` runtime evidence, source-safe AssetPack preview, settlement/right-transfer delivery boundary, and source-safe observability coverage.
The artifact records expected totals of two Reading pipelines, eleven phases, twelve PTRR agents, forty-eight PTRR steps, one hundred forty-four ThricifiedGeneration records, and four tool surfaces.
No missing, blocked, or exempt critical Reading integration row is allowed in the Gate 5 artifact, and prompt content rewriting remains deferred to V41.
7 changes: 4 additions & 3 deletions BITCODE_SPEC_V40_PARITY_MATRIX.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,8 +33,8 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
| Browser E2E | Critical website flows have browser proof | future V40 artifacts | not yet implemented |
| Visual proof | Screenshot comparisons are deterministic and reviewable | future V40 artifacts | not yet implemented |
| API integration | Route and API contracts are parseable and source-safe | `.bitcode/v40-api-integration-contracts.json` | implemented |
| Pipeline integration | Primitive and real Reading pipeline implementations are tested | future V40 artifacts | not yet implemented |
| Unit coverage | Packages, primitives, isolated implementations, and real implementations have unit coverage | future V40 artifacts | not yet implemented |
| Pipeline integration | Primitive and real Reading pipeline implementations are tested | `.bitcode/v40-reading-pipeline-integration-coverage.json` | implemented |
| Unit coverage | Packages, primitives, isolated implementations, and real implementations have unit coverage | `.bitcode/v40-unit-coverage-inventory.json` | implemented |
| Prompt benchmark smoke | Prompt and PromptPart benchmarks run before V41 | future V40 artifacts | not yet implemented |

## V40 implementation checklist
Expand All @@ -45,7 +45,7 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
| Gate 2 | Test inventory artifact and coverage matrix | implemented |
| Gate 3 | Unit coverage closure artifact | implemented |
| Gate 4 | API/route integration artifact | implemented |
| Gate 5 | Reading pipeline integration artifact | not yet implemented |
| Gate 5 | Reading pipeline integration artifact | implemented |
| Gate 6 | Conversation/Terminal integration artifact | not yet implemented |
| Gate 7 | Browser/visual/accessibility/responsive artifact | not yet implemented |
| Gate 8 | Ledger/database/storage/wallet/delivery sync artifact | not yet implemented |
Expand All @@ -56,6 +56,7 @@ This matrix records the V40 testing surfaces that must become promotion-grade be
Gate 2 implementation evidence: package-backed `V40TestInventoryCoverageMatrix` emits `.bitcode/v40-test-inventory-coverage-matrix.json` and is wired through `check:v40-gate2`.
Gate 3 implementation evidence: package-backed `V40UnitCoverageInventory` emits `.bitcode/v40-unit-coverage-inventory.json` and is wired through `check:v40-gate3`.
Gate 4 implementation evidence: package-backed `V40ApiIntegrationContracts` emits `.bitcode/v40-api-integration-contracts.json` and is wired through `check:v40-gate4`.
Gate 5 implementation evidence: package-backed `V40ReadingPipelineIntegrationCoverage` emits `.bitcode/v40-reading-pipeline-integration-coverage.json` and is wired through `check:v40-gate5`.

## V40 accepted boundaries

Expand Down
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -539,6 +539,13 @@ V40 Gate 4 adds the package-backed `V40ApiIntegrationContracts`, generated
source-safe API, UAPI, MCP, ChatGPT App, persistence, authorization, and
response-schema route integration contract coverage before later browser and
pipeline gates.
V40 Gate 5 adds the package-backed `V40ReadingPipelineIntegrationCoverage`,
generated `.bitcode/v40-reading-pipeline-integration-coverage.json`, and
`check:v40-gate5` to close source-safe integration coverage for
`ReadNeedComprehensionSynthesis`, `ReadFitsFindingSynthesis`, many-fit
Depository search, PTRR agent wiring, AssetPack preview/settlement/delivery,
telemetry/readback, Terminal harnesses, pipeline primitives, hosts, and local
staging rehearsal linkage.
V38 Gates 1 through 11 are wired through `pnpm run check:v38-gate1`,
`pnpm run check:v38-gate2`, `pnpm run check:v38-gate3`,
`pnpm run check:v38-gate4`, `pnpm run check:v38-gate5`,
Expand Down
Loading
Loading