sched: pipeline the delivery of a host-resident KV cache - #39

sched: pipeline the delivery of a host-resident KV cache#39

Piggidragon wants to merge 38 commits into

GenerelSchwerz:llama/devGenerelSchwerz/llama.cpp:llama/devfrom

Piggidragon:kv/pipelined-transportPiggidragon/llama.cpp:kv/pipelined-transportCopy head branch name to clipboard