Skip to content

V38 Gate 4: PromptPart And Prompt Benchmarking#127

Merged
geraldarthurdavis merged 1 commit into
version/v38from
v38/gate-4-promptpart-prompt-benchmarking
May 24, 2026
Merged

V38 Gate 4: PromptPart And Prompt Benchmarking#127
geraldarthurdavis merged 1 commit into
version/v38from
v38/gate-4-promptpart-prompt-benchmarking

Conversation

@geraldarthurdavis

Copy link
Copy Markdown
Contributor

Summary

  • adds source-safe V38PromptBenchmarkReport generation/checking for PromptPart and complete Prompt benchmark coverage
  • covers Reading pipeline prompts, Conversation prompts, DocCode/tool-definition prompts, benchmark runner infrastructure, fixtures, typed-output quality expectations, and disclosure tiers
  • wires Gate 4 into package scripts, protocol exports, protocol tests, V38 docs, roadmap, and gate/canon quality workflows

Validation

  • pnpm run check:v38-gate1
  • pnpm run check:v38-gate2
  • pnpm run check:v38-gate3
  • pnpm run check:v38-gate4
  • node --test --test-force-exit packages/protocol/test/v38-prompt-benchmark-report.test.js
  • pnpm --filter @bitcode/protocol typecheck
  • pnpm --filter @bitcode/protocol test
  • node scripts/run-bitcode-spec-quality.mjs --mode strict-version --version V38
  • pnpm --dir packages/prompts exec tsx src/benchmarking/cli.ts benchmark:report
  • git diff --cached --check

Notes

  • Direct packages/prompts tsc remains blocked by existing workspace rootDir/file-list configuration issues after TypeScript 6 deprecation warnings are bypassed; the maintained Gate 4 checks and CLI smoke test pass.

Add the source-safe V38PromptBenchmarkReport artifact for PromptPart and complete Prompt benchmarking across Reading, Conversation, and tool-definition surfaces.

Wire the Gate 4 generator, checker, protocol exports, workflow checks, and protocol tests; update V38 specifications, roadmap, and documentation with the closure anchor.

Validation: pnpm run check:v38-gate1; pnpm run check:v38-gate2; pnpm run check:v38-gate3; pnpm run check:v38-gate4; node --test --test-force-exit packages/protocol/test/v38-prompt-benchmark-report.test.js; pnpm --filter @bitcode/protocol typecheck; pnpm --filter @bitcode/protocol test; node scripts/run-bitcode-spec-quality.mjs --mode strict-version --version V38; pnpm --dir packages/prompts exec tsx src/benchmarking/cli.ts benchmark:report; git diff --cached --check.
@vercel

vercel Bot commented May 24, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
engi-uapi Ready Ready Preview, Comment May 24, 2026 11:06pm

@geraldarthurdavis
geraldarthurdavis merged commit 8e88738 into version/v38 May 24, 2026
28 checks passed
@geraldarthurdavis
geraldarthurdavis deleted the v38/gate-4-promptpart-prompt-benchmarking branch May 24, 2026 23:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant