Skip to content

llama: add pshard runtime for plan switching and streamed weights - #22692

Open
aukarande wants to merge 2 commits into
ggml-org:masterfrom
aukarande:pshard/inference
Open

llama: add pshard runtime for plan switching and streamed weights#22692
aukarande wants to merge 2 commits into
ggml-org:masterfrom
aukarande:pshard/inference

Fix pshard prefetch tracking, state remaps, and common-weight preload

c64c73d
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.