perf(ArcInfer/ArcGraph): device decode loop — 2 host syncs per token to 0, opt-in - #217

perf(ArcInfer/ArcGraph): device decode loop — 2 host syncs per token to 0, opt-in#217

heydryft merged 4 commits into

release/openrouter-readyaeonmindai/arc:release/openrouter-readyfrom

arcgraph/device-decode-loop-relaeonmindai/arc:arcgraph/device-decode-loop-relCopy head branch name to clipboard