Skip to content

fix(custom-model): warn when parallel llama.cpp slots leave too little context per request - #658

Closed
opticon454 wants to merge 4 commits into
Ark0N:masterfrom
opticon454:feature/llamacpp-slot-aware-context
Closed

fix(custom-model): warn when parallel llama.cpp slots leave too little context per request#658
opticon454 wants to merge 4 commits into
Ark0N:masterfrom
opticon454:feature/llamacpp-slot-aware-context

fix(custom-model): an explicit --parallel replaces a stale slot count…

72baebb
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
Unit & integration tests
succeeded Oct 20, 2026 in 12m 2s