Repository navigation
[PR] fix: parse LiteLLM input and completion overflow counts - #5969
Conversation
…leanup) Line 111 asserted st.overflowArmCompletionReserve === 5000, identical to the pre-existing line 136 (ranxianglei#3450). Removing the redundant copy; coverage is unchanged.
(ai: vllm-qwen/qwen3.8-27b) Note: I initially posted these findings to the wrong thread number ( Reviewed against live master ( Dup screeningNot a duplicate. Searched open + closed issues/PRs for the LiteLLM colon wording and
What I verified
Cleanup I pushed (one line, on your branch)
Regression / existing-behavior checkNew branch sits after the OpenAI-parens pattern and before Anthropic/Gemini/CJK → can't shadow any earlier match; tight anchor means no over-match (throttle-400 and the incomplete splits don't match). No behavior change beyond adding the missing parse. No kernel/config/persistence/wire-shape/outgoing-content change. CI (live, head
|
📦 Merged Build PublishedThis merge to master was published as npm install -g billion-context@0.0.1109-master.1bc2faf # this exact build
npm install -g billion-context@master # always the newest merged build
|
…ndow refusal, ranxianglei#5969 LiteLLM overflow counts Advances the base from 1f311dd to 39fc2ee (8 commits, 8 files). The only file this lane shares with the delta is scripts/live-files.mjs, and both sides are byte-identical (md5 295a1317030b28dbff36539f8e97d176): upstream landed the same ranxianglei#1248 registration this lane already carried from the ci-check commit 156d0c8, so the merge is a no-op there and git auto-resolved everything else. Notable upstream commits adopted: - 4ec9778 fix: empty-slot direct send now refuses over-window bodies locally (ranxianglei#5996) - 12b18e9 fix(native-intercept): name the floored local bar distinctly from the resolved window in the empty-slot refusal (ranxianglei#5996 review) - 8b25694 fix: parse LiteLLM input and completion overflow counts (ranxianglei#5969) - 911737c test: drop duplicate overflowArmCompletionReserve assertion - 831b645 fix(ci): register tests/issue5955-wedged-same-lane-takeover.test.ts in LIVE_FILES
Fixes #5967
LiteLLM/SGLang context-overflow errors use
requested a total of N tokens: M tokens from the input messages and C tokens for the completion. The existing parser recognizes the window but loses all three counts, so overflow recovery cannot use the stated input measurement or completion reservation.Add this narrowly anchored variant alongside the existing parenthesized OpenAI/DeepSeek format. Reuse the existing calibration and headroom mechanisms; retain incomplete/error-status negative controls. Both plugin and proxy modes share the parser. Add bilingual technical notes.
Validation
npm run typecheckpasses.npm run buildpasses (dist import annotations and external-dependency checks included).git diff --checkpasses.Scope
This fixes missing error-format parsing, not DSH fork-state reconstruction. DSH intentionally omits parentSession on ordinary forks; compatibility and block-adoption behavior require a separate investigation. No claim that this parser patch alone restores every affected fork. No change to kernel, config, persistence, declared model windows or outgoing message contents.
All new fixtures use synthetic values. Human review/merge only.