Repository navigation

Guard the sliding-window ring KV cache: concat on prefill, write-first on decode (#314) - #339

Closed

stikves wants to merge 4 commits into

stikves:sukru/fix-issue-314

Closed

Guard the sliding-window ring KV cache: concat on prefill, write-first on decode (#314)#339
stikves wants to merge 4 commits into
apple:mainfrom
stikves:sukru/fix-issue-314

Commits on Oct 10, 2026
- Attend before writing the sliding-window ring, to keep prefill history
  
  Lewis300
  authored and
  stikves
  committed
  df1fd28
- Add Q>1 post-wrap parity test for sliding-window ring cache
  stikves
  committed
  46d0445
- Guard ring concat write index stays a shape symint
  stikves
  committed
  fed102d
Commits on Oct 11, 2026
- Guard sliding-window ring: concat on prefill, fast write-first on Q=1 decode
  stikves
  committed
  2f2b502