Skip to content

Settle the open conformance rows and benchmark Silesia on release - #111

Merged
afflom merged 20 commits into
mainfrom
claude/project-thread-wg24ye
Nov 10, 2026
Merged

afflom merged 20 commits into
mainfrom
claude/project-thread-wg24ye

Conversation

@afflom

@afflom afflom commented Nov 9, 2026 •

Copy link
Copy Markdown
Member

Requested by Alex · project thread

Closes #108 and #51. This is up to date with main as of af373ea, which includes #110, #112, #113, #114 and #116.

Conformance rows (#108)

The 17 open rows are settled as follows:

Disposition Rows
Bound to the shipped client (build) UC-REAL-01 (fixture_result), UC-API-01, UC-OBJ-01, UC-BAS-01, UC-WIRE-01, UC-INT-01, UC-MACH-01, UC-MACH-02, UC-SYN-01, UC-OPT-01
Retired (old Hologram/View product model, which nothing ships) UC-PROD-01, UC-CTL-01, UC-VIW-01, UC-STG-01, UC-EXE-01, UC-CHK-01, UC-INT-06

After this PR, only two rows are open, both by design: UC-PERF-01 (measure only) and UC-REC-01 (external record).

Each bound row describes what the client does, and its evidence lives in crates/uorc/tests/conformance.rs and the uorc-wasm exports test:

  • library, uorc binary and Wasm agreement on compress, decompress, inspect and verify, at both levels
  • multi-object archives with zero objects and with distinct empty objects
  • the standard basis identity, plus a resealed archive that names another basis and is rejected
  • truncation, trailing bytes and every flipped bit
  • refusal when the work budget runs out
  • search monotonicity, never larger than raw, and --best never larger than the default

No new CI legs: the tests run inside the existing cargo test --workspace, and the conformance file takes about 4 s.

Retiring the rows also removes xtask/src/product_receipts.rs, the seven per-flow product tests in xtask/src/product_execution.rs, the runtime scripts that only those tests called, and xtask/src/open_claims.rs.

Release benchmark (#51)

  • scripts/bench.mjs takes several corpora (--corpus a,b) and measures uorc at the default level and at --best against gzip, bzip2, xz, zstd and brotli.
  • For each corpus it reports archive bytes, ratio, and compress and decompress MB/s, plus per-file sizes, in bench.{json,md,html}.
  • release.yml has a bench job that runs only on v* tags. It runs Canterbury and Silesia with a 120-minute budget, then puts bench.md in the release notes and bench.html on the Pages site.

Checks run locally

  • cargo test -p uorc (35 lib, 7 cli, 10 conformance), -p uorc-wasm, -p repo-conformance and -p repo-model: all pass.
  • lexlean fmt --check --all and check-model: clean.
  • clippy -D warnings and cargo fmt --check: clean.

🤖 Generated with Claude Code

https://claude.ai/code/session_013Asa3Pb2pARmowTZwiuFLV

claude and others added 11 commits November 8, 2026 11:08
…ges site, release and bench

Uorc.Client composes Search.Engine (whole-buffer compress under a step budget)
and the ArchiveTrial decode phases (decompress). scripts/client-export.mjs
stages the closure, marks it executable, works around LexLean 0.4.0 LLV7015
with a typed let wrap, and runs the certified production build into
generated/rust. Work in progress: the exported Rust is far slower than the
Lean-native build and overflows the stack on deep recursion.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
The client crates are re-exported with LexLean at 7da569d (rust-std keeps
datatype fields behind Rc), pinned in scripts/client-export.mjs until the
lowering is released. Compress runs 18x and decompress 5x faster than the
inline-record export, and the WebAssembly stack drops from 256 MiB to 64 MiB.
The generated crates leave the workspace members so the workspace fmt and
clippy gates do not re-lint or reformat LexLean's output.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
The authority graph links Client against a closure that is not marked
executable, so lexlean check refused Client's executable definitions
(LLT4001). The export now adds executability and the two production
annotations on its staged copy; the staged data form equals the one the
committed packages were exported from.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
The template trust root requires every checkout to fetch full history.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
…-place byte update #443)

The export pin moves to the branch that carries both LexLean patches; the
re-exported client gains the std runtime's Bytes::update and is otherwise
unchanged. The pin moves to a LexLean release once both ship.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
compress now writes a standard UORC program archive whose graph is the ulz
decoder kernel (45 blocks, ~3 KB on the wire) and whose payload is the ulz
encoder's output, or the raw archive when that is smaller. The program search
runs only when --steps asks for it. decompress recognises a kernel archive by
rebuilding it byte for byte, runs the certified LexLean decoder, and keeps the
result only if re-encoding reproduces the payload; every other archive takes the
reference path. The current reference client decodes kernel archives by the
graph semantics, and a test decodes one that way.

1 MB inputs: rust.rs 54,366 B (gzip -9 61,786, xz -9 46,924), elf.bin 202,696 B
(gzip 238,109, xz 183,444); compress 0.7-1.9 s, decompress 0.7-1.9 s.

The codec and the client live in client/src, outside the authority project,
because the codec's tables use the in-place byte update that only the pinned
LexLean has; client-export stages client/src over src. client/gen holds the
writing aids (regenerate with client/gen/build.sh; check_graph.py runs the
kernel graph by a Python mirror of the reference semantics).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
…ce path

decompress recognises a raw archive by rebuilding it from its body and
comparing bytes, so a stored input decodes in milliseconds.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
Scalars move to low store keys with per-width accessors, and the payload
is copied into the store once instead of being threaded through every
block. Archives shrink by about 390 bytes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Nk2H9geAZ2GKFCNvM
Registry (#108):
- Bind UC-REAL-01, UC-API-01, UC-WIRE-01, UC-INT-01, UC-MACH-01,
  UC-MACH-02, UC-SYN-01 and UC-OPT-01 to the shipped client, narrowed to
  what it does, with tests in crates/uorc/tests/conformance.rs and the
  uorc-wasm exports test.
- UC-OBJ-01 and UC-BAS-01 stay open and say why in their own text.
- Retire UC-PROD-01, UC-CTL-01, UC-VIW-01, UC-STG-01, UC-EXE-01,
  UC-CHK-01 and UC-INT-06 (old Hologram/View product model), with the
  xtask tests and runtime scripts that only served them.

Benchmark (#51):
- bench.mjs takes several corpora and writes a per-corpus size, ratio
  and throughput summary to bench.{json,md,html}.
- release.yml runs it in its own release-only job on Canterbury and
  Silesia; the table goes into the release notes and the Pages site.
- UC-PERF-01 states this measure-only disposition.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Pb2pARmowTZwiuFLV
@afflom afflom self-assigned this Nov 9, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Pb2pARmowTZwiuFLV
…-wg24ye

# Conflicts:
#	.github/workflows/release.yml
#	crates/uorc-wasm/src/lib.rs
#	scripts/bench.mjs
@afflom
afflom changed the base branch from claude/project-thread-jl6avw to main November 9, 2026 16:14
…ands

UC-API-01 now covers inspect and verify across library, CLI and Wasm;
UC-OBJ-01 is build evidence from multi-object archives (zero objects,
distinct empty objects, truncation and trailing bytes).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Pb2pARmowTZwiuFLV

afflom commented Nov 9, 2026

Copy link
Copy Markdown
Member Author

The acceptance / ubuntu-24.04 aggregate fails because the integrity and reproducibility legs were never created: GitHub reports the matrix result as abandoned, and neither leg ran a step. I re-ran the workflow once and got the same result.

This failure isn't caused by this PR:

  • Every leg that did run passed on aae1267: rest x86/arm, artifacts, claims and varint, plus the projections job.
  • main at 37498ea has the same quick failure in its own bootstrap run (run 42672232157), with no change to bootstrap.yml.
  • Several lane PRs are running the matrix at the same time, which points to runner allocation rather than code.

There's no code fix to port. I'll re-run once the other runs drain.


Generated by Claude Code

afflom and others added 6 commits November 9, 2026 15:10
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Pb2pARmowTZwiuFLV
- UC-BAS-01 is build evidence: archives at both levels name the
  UORC-BASIS-V1 identity, and a resealed archive naming another basis
  fails to decode. Only UC-PERF-01 (measure only) and UC-REC-01
  (external record) remain open, so open_claims.rs is gone.
- Row tests and the wasm test take compress's level argument; OPT-01
  also checks --best is never larger than the default; WIRE-01 and
  OPT-01 describe linked archives and the ncm candidate.
- bench.mjs measures the default level and --best on every corpus.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013Asa3Pb2pARmowTZwiuFLV
@afflom
afflom merged commit 9059c17 into main Nov 10, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Settle the open conformance rows: bind evidence or retire them

2 participants