Skip to content

Runtime knobs (ctx/util/seqs/async/APC/drafter block) + mamba prefix-hit seed fix (vllm#55600), README on the single-Spark memory budget - #4

Open
pondzikk wants to merge 1 commit into
gitcommit90:mainfrom
pondzikk:one-spark-knobs-and-mamba-seed-fix
Open

Runtime knobs (ctx/util/seqs/async/APC/drafter block) + mamba prefix-hit seed fix (vllm#55600), README on the single-Spark memory budget#4
pondzikk wants to merge 1 commit into
gitcommit90:mainfrom
pondzikk:one-spark-knobs-and-mamba-seed-fix

Runtime knobs, drafter block override, and mamba prefix-hit seed fix …

b358952
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs