kolibri1 CPU: n-gram spec-decode — the 12 tok/s target is cleared (14.0 tok/s bench, 8.2 realistic) - #3449

kolibri1 CPU: n-gram spec-decode — the 12 tok/s target is cleared (14.0 tok/s bench, 8.2 realistic)#3449

lu-zero merged 2 commits into

localai-org:mainlocalai-org/vllm.cpp:mainfrom

lu-zero:row/kolibri-spec-probelu-zero/vllm.cpp:row/kolibri-spec-probeCopy head branch name to clipboard