server: reuse checkpoint state buffers from a bounded pool - #201

server: reuse checkpoint state buffers from a bounded pool#201

danielhanchen wants to merge 6 commits into

masterunslothai/llama.cpp:masterfrom

perf/checkpoint-buffer-poolunslothai/llama.cpp:perf/checkpoint-buffer-poolCopy head branch name to clipboard