Repository navigation
Bump llama.cpp: f08bd76f672d (HRX test suite, #533 case 1, #444 route expectations, Flint, jinja \x escapes) - #544
bong-water-water-bong wants to merge 4 commits into
Conversation
…ner, #533 case 1, test-hrx-ops kquant routes Fork #126 (publication assertions, closes engine #449), #127 (PAD param dump compile fix + test-hrx-ops on the suite runner), #128 (kquant decode route expectations), #129/#130 (#445 rows at the current pin), #131 (#533 case 1: absent bias/residual slots bind a read-only value - verifier passes, numerically inert). Tests and diagnostics only; the one backend change (#127 PadParams dump branch, #131 placeholder binding) is covered by hrx-backend-test and the model A/B tables in #131. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
PR Reviewer Guide 🔍(Review updated until commit c7bfb06)Here are some key observations to aid the review process:
|
…ons) Fork #132 (tests only): require_matmul_route() accepts the table's kernel or the registered kquant decode family and prints the scheduled sequence when neither is there; stale decode/prefill sibling names and three routed-MoE names replaced from the first device run's log (engine #444). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Persistent review updated to latest commit 7b6fbbe |
Fork #134 ports upstream llama.cpp #30928: Flint (FlintForCausalLM), the 40B-A2.5B MoE coder with hybrid sliding-window/full attention, learned sinks and per-layer RoPE flags. CPU-verified on ryzen (greedy coherence on three prompts, PPL 5.56 on 10 chunks); the HRX build and test-llama-archs on gfx1151 are this gate's job. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Persistent review updated to latest commit 03a06ab |
Fork #135 lets the vendored jinja lexer accept \xNN hex escapes, so a chat template that opens with replace("\x00", "") (Flint's does) no longer aborts serve and the onebit backend before the model loads. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Persistent review updated to latest commit c7bfb06 |
|
Superseded by #565 ( Closing per the release queue (the pin only moves once #565's hardware gate is green). |
Moves third_party/llama.cpp from
851fa6c8d8f2to the fork tipf08bd76f672d(branch 1bit/hrx-vulkan-patched).Fork PRs #126-#131: hrx-backend-test and test-hrx-ops on the suite runner with route expectations re-ruled at this pin (engine #444/#445/#449), the PadParams op-params dump branch (the tree did not compile with GGML_HRX=ON since fork #114), and #533 case 1 (the fused MoE postops kernel's absent bias/residual slots bind a read-only value; verifier passes; per-token logprobs bit-identical on Qwen3-Coder-30B).
Fork PR #132 (tests only): require_matmul_route() accepts the table's kernel or the registered kquant decode family and prints the scheduled sequence when neither is there; stale decode/prefill sibling names and three routed-MoE names replaced from the first device run's log. The hw-gate ops phase at this pin is the device re-run engine #444 waits for.
Fork PR #135: the vendored jinja lexer accepts
\xNNescapes, which Flint's chat template needs before the model even loads (five lexer tests).Fork PR #134: the Flint architecture (RecursiveSI/flint, 40B total / 2.5B active MoE coder, Apache-2.0), ported from upstream llama.cpp #30928 with three small prerequisites (per-layer RoPE flags, a K-shift guard for NoPE layers, saver opt-out). CPU-verified on ryzen with unsloth's UD-Q4_K_XL (coherent greedy output on three prompts, PPL 5.56 on 10 chunks). This gate is the first HRX build of that code; the device run (serve chat, llama-bench, KLD vs CPU) and the Lemonade catalog entry follow once the leaderboard releases the GPU lane.
Merge by hand after hw_gate passes (auto-merge off); the hw-gate label goes back on once the leaderboard releases the GPU. Not part of the rc-2026-10-23 packages (the owner tags 74f64c7).
🤖 Generated with Claude Code