server: take the park and restore copies off the decode loop - #192
Draft
danielhanchen wants to merge 48 commits into
Draft
danielhanchen wants to merge 48 commits into
danielhanchen wants to merge 48 commits into
Commits
Commits on Sep 6, 2026
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Sep 7, 2026
- committed
- committed
- committed
- committed
- committed
- committed
- committed
llama: the shift wait runs before the draft is asked for; the last transfer takes the fences with it
committed- committed
- committed
- committed
- committed
Merge /mnt/disks/unslothai/daniel3/workspace_12/llamacpp_fork into feat/server-side-preemption-async
committed