Skip to content

Reduce repeated host conformance work and bound scaling to Linux (#235) - #400

Merged
afflom merged 1 commit into
release/v0.4from
maintenance/issue-235-host-cost
Nov 3, 2026
Merged

afflom merged 1 commit into
release/v0.4from
maintenance/issue-235-host-cost

Conversation

@afflom

@afflom afflom commented Nov 3, 2026 •

Copy link
Copy Markdown
Member

The Intel macOS host gate took about 144 minutes in successful run 41478333299 at afe1a002; its 468 conformance tests took 7,470.84 seconds, with SP-02, TC-03 and TC-05 forming the tail.

This keeps the full SP-02 scaling/seeded stress families and TC-03 seeded argument/fuel sweep on normative Linux x86-64. Every supported host retains the committed corpus/fixture assertions, negative certificate-limit cases and fixed small certificate vectors. TC-03 and TC-05 now render and parse the shared fixture modules once into a declaration-name set, preserving every name-membership and template assertion. The register, scenarios and SPEC state the host split; CONFORMANCE.md was regenerated. No acceptance recipe, build cache, additional macOS shard or kernel replay is introduced or removed.

Implements the measured CI-cost reduction for #235. The remaining acceptance item—the new measurement in the workflow timeout comment—is carried by #406, which will close #235 after its final gate passes.

Measured Intel result: job 125773640497 in run 41592896657 passed in 117m01s, versus 144m02s for baseline job 125390659100/run 41478333299 (27m01s less, 18.76%). All 468 conformance cases passed in 6021.07s versus 7470.84s (19.41% less). The 240-minute timeout is unchanged.

Validation on the final source:

  • Formatting, validate-model (468 IDs, 86 codes), validate-spec-links, all five BDD meta-gate tests, and workspace/all-target/all-feature Clippy with warnings denied pass.
  • Isolated TC-05 reaches the Lean-host check after all template/declaration assertions in 4.53 seconds, then fails: this environment provides Lean through ELAN_HOME while the conformance helper requires $HOME/.elan. This is a blocked Lean-backed test, not a pass or an Intel measurement.
  • Final-head CI 41592896657 passed all 42 jobs, including normative cases and all supported hosts; honesty and reproducibility also passed. No helper-path workaround or source plant was used.

Based on release/v0.4 at 90fb7f152. Published tree 354438f4d6f7e48268ae3e50885c5f6a96581ac4 matches the locally reviewed and validated commit tree.

Merged as 477a508. The actual merge tree e02d1637615872ccf1eff1588cb57b1b9fda3ce6 matches the reviewed integration: the complete difference from the tested source tree is the independently reviewed and fully passing #397 documentation. Forward propagation is tracked by #404/#405.

afflom commented Nov 3, 2026

Copy link
Copy Markdown
Member Author

Post-change Intel evidence is now complete at head 30612d26570660453f4a5c11eca9fb7357118375: job 125773640497 passed all 468 conformance cases in 6021.07 seconds, versus 7470.84 seconds in baseline job 125390659100/run 41478333299: 24m09.77s less (19.41%). API job timestamps are 06:55:40–08:52:41 UTC, 117m01s, versus 144m02s baseline: 27m01s less (18.76%). These are actual hosted-run measurements, not a projection or an isolated benchmark.

Independent source review confirms the retained host corpus/limit checks and unchanged normative Linux stress coverage; the tested merge 250dba03bfb86a79605c4fabcbe0a62ad89682b8 has the reviewed source tree. Honesty and reproducibility passed. The complete 42-job listing currently has 41 successes and bdd-bootstrap-package still running, so #235 stays open and this PR is not yet cleared to merge. The existing timeout remains unchanged.

@afflom afflom left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Final review cleared after independent Sol 6.1 source review and measured Intel evidence. CI 41592896657 now passes all 42 jobs, including the final bootstrap-package leg; honesty and reproducibility also pass. The tested tree is 354438f4d6f7e48268ae3e50885c5f6a96581ac4. A clean merge against current v0.4 b37bd79 produces tree e02d1637615872ccf1eff1588cb57b1b9fda3ce6; the complete difference from that tested tree is the already reviewed and fully green #397 documentation (README, SPEC §21.5, docs/LEAN-CONSUMER.md). No code, claim, fixture or CI conflict resolution is required. Intel actual job time fell from 144m02s to 117m01s; conformance time fell 19.41%, with all 468 cases passing. Normative stress and supported-host corpus/limit checks remain intact. Cleared to merge and close #235.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant