Repository navigation
llama: retry pipeline reservation with fewer copies - #20
Conversation
Assisted-by: Codex
|
Pre-merge handoff to Codex Focused Maximum-context and near-full-pool acceptance, long-context behavior, cancellation, simultaneous two-slot qualification, combined-route qualification and final deployment remain outstanding. PR remains draft; merge is on hold for root's continuing qualification. |
|
Post-merge handoff: PR #20 is squash-merged at Root will continue exact merged-source deployment and proxy verification, maximum-context/near-full-pool, long-context, cancellation, simultaneous two-slot and combined-route qualification after merge. The combined trace reported by root (70,000 new tokens plus 512 generated, GPU-resident layers, two-copy pipeline) is state/route evidence only. No final acceptance or deployment is claimed here. |
Addresses #9
Overview
When pipeline copy-buffer reservation fails, retry with two copies before the existing one-copy generic fallback. Successful four-copy reservations stay unchanged; this does not set a global two-copy default. The Flash acceptance checks reject the one-copy result; generic one-copy fallback remains available.
Validation
test-allocpassed on CPU and on the matched native/RPC build.109ab654plus this patch passed a proxy :8082 capacity screen with RPC-first placement,ub=1024, two slots, pipeline enabled and all 49 target plus 50 draft layers on GPU. At shared contexts 233472, 249856 and 266240, the initial four-copy reservation failed and the two-copy retry succeeded. One cold 8192+512 request completed at each context.Remaining qualification
This PR does not claim maximum-context or near-full-pool acceptance. Long-context behavior, cancellation, simultaneous two-slot qualification, combined-route qualification and final deployment remain outstanding in issue #9. Root will continue this qualification after merge; this PR is not final task acceptance.
Requirements