Repository navigation
Conversation
… in MoE" #1464: an RTX 3080 under WSL2 failed every prompt with request failed: hybrid batched block failed in MoE and a day of flag-flipping could not narrow it, because that message is the generic tail of the layer block. moe_token_pipeline and v4_moe_batch_union can fail in some thirty places -- an expert that would not read, an upload that would not land, the GPU expert group refusing, a routing table missing, a plain malloc -- and every one of them returned a bare -1. The block could not tell an out-of-VRAM card from a bad read over /mnt/c, so neither could the reporter. Every failure site now records a reason (layer, expert where there is one, and the step) through moe_fail(), thread-local and cleared on entry so a stale one cannot outlive the call that set it, and both block tails append it: hybrid batched block failed in MoE: layer 12: the GPU expert group of 6 experts refused (a CUDA allocation or launch failed; check nvidia-smi for free VRAM) block computation failed in MoE: layer 3: reading expert 137 from the expert store failed No behaviour changes on any success path; the only difference is the text in the error buffer. Everything lives in the COLI_V4_UNIT_BLOCK_HYBRID unit, which needed <stdarg.h> of its own since set_error's unit is a different object. tests/test_v4_moe_reason_source.py pins the shape: the only `result = -1` left in those two functions are the "not finished yet" job markers, both functions clear the reason on entry, and both block tails read it. It fails on the tree before this commit. The tiny V4 oracle stays token-exact (target long, CLI, serve, prefix reuse).
fix(deepseek-v4): the MoE step says why it failed, instead of "failed in MoE"
The invite we publish is dead again. The Discord API on the code in the tree:
GET /api/v10/invites/FkyrEeJR -> {"message": "Invite is expired.", "code": 50270}
It appears in ten places: the header badge and the community line of all
four READMEs, and twice in site/index.html. Anyone clicking Discord from the
repo or the site lands on an error page.
Replaced with an invite created with no expiry, verified live before this
commit:
GET /api/v10/invites/RXV83nSZdk -> guild "Colibri - inference AI",
expires_at: null, ~130 members
The previous replacement (#1363) died because Discord's default invite
lifetime is seven days; the first candidate for this one had
expires_at 2026-09-20 and was rejected for the same reason.
Owner
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Same single commit as #1471, aimed at
mainso the badge and the community line on the default branch stop pointing at a dead link. Docs only, no tag: no release build runs and no archives change.Not a
dev -> mainmerge on purpose:devis already ahead ofv1.11.0with #1468 (engine code), which must not reachmainuntagged. This carries exactly the ten replaced occurrences.Verified live before opening:
GET /api/v10/invites/RXV83nSZdk-> guild "Colibri - inference AI",expires_at: null. The oldFkyrEeJRanswersInvite is expired(50270).Merge with
--admin(main is protected).