Skip to content

Bump llama.cpp: f08bd76f672d (HRX test suite, #533 case 1, #444 route expectations, Flint, jinja \x escapes) - #544

Closed
bong-water-water-bong wants to merge 4 commits into
mainfrom
bump-llamacpp/f1670b43c93c
Closed

bong-water-water-bong wants to merge 4 commits into
mainfrom
bump-llamacpp/f1670b43c93c

Conversation

@bong-water-water-bong

@bong-water-water-bong bong-water-water-bong commented Oct 23, 2026 •

Copy link
Copy Markdown
Collaborator

Moves third_party/llama.cpp from 851fa6c8d8f2 to the fork tip f08bd76f672d (branch 1bit/hrx-vulkan-patched).

Fork PRs #126-#131: hrx-backend-test and test-hrx-ops on the suite runner with route expectations re-ruled at this pin (engine #444/#445/#449), the PadParams op-params dump branch (the tree did not compile with GGML_HRX=ON since fork #114), and #533 case 1 (the fused MoE postops kernel's absent bias/residual slots bind a read-only value; verifier passes; per-token logprobs bit-identical on Qwen3-Coder-30B).

Fork PR #132 (tests only): require_matmul_route() accepts the table's kernel or the registered kquant decode family and prints the scheduled sequence when neither is there; stale decode/prefill sibling names and three routed-MoE names replaced from the first device run's log. The hw-gate ops phase at this pin is the device re-run engine #444 waits for.

Fork PR #135: the vendored jinja lexer accepts \xNN escapes, which Flint's chat template needs before the model even loads (five lexer tests).

Fork PR #134: the Flint architecture (RecursiveSI/flint, 40B total / 2.5B active MoE coder, Apache-2.0), ported from upstream llama.cpp #30928 with three small prerequisites (per-layer RoPE flags, a K-shift guard for NoPE layers, saver opt-out). CPU-verified on ryzen with unsloth's UD-Q4_K_XL (coherent greedy output on three prompts, PPL 5.56 on 10 chunks). This gate is the first HRX build of that code; the device run (serve chat, llama-bench, KLD vs CPU) and the Lemonade catalog entry follow once the leaderboard releases the GPU lane.

Merge by hand after hw_gate passes (auto-merge off); the hw-gate label goes back on once the leaderboard releases the GPU. Not part of the rc-2026-10-23 packages (the owner tags 74f64c7).

🤖 Generated with Claude Code

…ner, #533 case 1, test-hrx-ops kquant routes

Fork #126 (publication assertions, closes engine #449), #127 (PAD param dump compile fix + test-hrx-ops on the suite runner), #128 (kquant decode route expectations), #129/#130 (#445 rows at the current pin), #131 (#533 case 1: absent bias/residual slots bind a read-only value - verifier passes, numerically inert). Tests and diagnostics only; the one backend change (#127 PadParams dump branch, #131 placeholder binding) is covered by hrx-backend-test and the model A/B tables in #131.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@bong-water-water-bong bong-water-water-bong added the hw-gate Run the HRX hardware gate on Strix Halo (docs/hw-gate.md) label Oct 23, 2026
@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown

PR Reviewer Guide 🔍

(Review updated until commit c7bfb06)

Here are some key observations to aid the review process:

🎫 Ticket compliance analysis 🔶

126 - Partially compliant

Compliant requirements:

  • Meta description and title formatting rules implemented
  • README page description updated to "Meet the engine"
  • Blog index description updated to a real description
  • All pages under character limits
  • No duplicate titles
  • Visible headings unchanged

Non-compliant requirements:

  • None

Requires further human verification:

  • None

131 - Partially compliant

Compliant requirements:

  • ZAYA models are convertible and their perplexity values are documented
  • Decode performance for ZAYA1-reasoning-base is documented
  • ZAYA1-8B comparison perplexity is documented
  • Multi-sequence fix is implemented

Non-compliant requirements:

  • None

Requires further human verification:

  • None

444 - Partially compliant

Compliant requirements:

  • Test expectations updated to reflect current routing
  • Test binaries are moved to testing_suite.h runner

Non-compliant requirements:

  • None

Requires further human verification:

  • None
⏱️ Estimated effort to review: 3 🔵🔵🔵⚪⚪
🧪 PR contains tests
🔒 No security concerns identified
⚡ Recommended focus areas for review

Subproject Commit Update

The PR updates the subproject commit for llama.cpp from 851fa6c8d8f220074ba73c7450ffb2219b27180b to f08bd76f672d06509e053bcdf68bb8fbadc0fb4f. This is a standard update of the third-party dependency, but it's important to verify that all the changes introduced by this commit align with the intended behavior and do not introduce regressions, especially in the context of HRX and Vulkan support.

Subproject commit f08bd76f672d06509e053bcdf68bb8fbadc0fb4f

@bong-water-water-bong bong-water-water-bong removed the hw-gate Run the HRX hardware gate on Strix Halo (docs/hw-gate.md) label Oct 23, 2026
…ons)

Fork #132 (tests only): require_matmul_route() accepts the table's kernel or
the registered kquant decode family and prints the scheduled sequence when
neither is there; stale decode/prefill sibling names and three routed-MoE
names replaced from the first device run's log (engine #444).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@bong-water-water-bong bong-water-water-bong changed the title Bump llama.cpp: f1670b43c93c (HRX test suite + #533 case 1) Bump llama.cpp: 830e2c161c68 (HRX test suite + #533 case 1 + #444 route expectations) Oct 23, 2026
@github-actions

Copy link
Copy Markdown

Persistent review updated to latest commit 7b6fbbe

Fork #134 ports upstream llama.cpp #30928: Flint (FlintForCausalLM),
the 40B-A2.5B MoE coder with hybrid sliding-window/full attention,
learned sinks and per-layer RoPE flags. CPU-verified on ryzen (greedy
coherence on three prompts, PPL 5.56 on 10 chunks); the HRX build and
test-llama-archs on gfx1151 are this gate's job.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@bong-water-water-bong bong-water-water-bong changed the title Bump llama.cpp: 830e2c161c68 (HRX test suite + #533 case 1 + #444 route expectations) Bump llama.cpp: c3eef46c0fec (HRX test suite, #533 case 1, #444 route expectations, Flint) Oct 23, 2026
@github-actions

Copy link
Copy Markdown

Persistent review updated to latest commit 03a06ab

Fork #135 lets the vendored jinja lexer accept \xNN hex escapes, so a
chat template that opens with replace("\x00", "") (Flint's does) no
longer aborts serve and the onebit backend before the model loads.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@bong-water-water-bong bong-water-water-bong changed the title Bump llama.cpp: c3eef46c0fec (HRX test suite, #533 case 1, #444 route expectations, Flint) Bump llama.cpp: f08bd76f672d (HRX test suite, #533 case 1, #444 route expectations, Flint, jinja \x escapes) Oct 23, 2026
@github-actions

Copy link
Copy Markdown

Persistent review updated to latest commit c7bfb06

@bong-water-water-bong

Copy link
Copy Markdown
Collaborator Author

Superseded by #565 (Bump HRX: llama.cpp e7e5cd08f9bb + hrx-system 82804197bcbe), which moves the same
third_party/llama.cpp pin past f08bd76f672d and carries the hrx-system hold-file checks with it. Closing this one
so there is a single llama.cpp bump in flight; nothing here is lost, the commits it pointed at are inside #565's pin.

Closing per the release queue (the pin only moves once #565's hardware gate is green).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant