[NVIDIA] chore: B200 single node DeepSeek v4 SGLang MTP#1145

Open

cquil11 wants to merge 18 commits intomainfrom

chore/dsv4-sgl-mtp-b200

Commits on Apr 24, 2026

Add dsv4-fp4-b200-sglang single-node config

cquil11
and
claude
committed
Switch dsv4-fp4-b200-sglang to Pro model, match vllm parallelism

cquil11
and
claude
committed
Match DSV4 Pro SGLang recipe literally; port HF cache path

cquil11
and
claude
committed
fix: use 'sglang serve' CLI, not python -m sglang.launch_server

cquil11
and
claude
committed
fix: mount repo at /ix for deepseek-v4-blackwell image

cquil11
and
claude
committed
fix: reinstall sglang from PyPI to work around masked editable install

cquil11
and
claude
committed
fix: uninstall editable sglang before reinstalling from PyPI

cquil11
and
claude
committed
fix: mount repo at /ix for deepseek-v4-blackwell; drop pip workaround

cquil11
and
claude
committed
fix: unset baked-in CUDA_VISIBLE_DEVICES for deepseek-v4-blackwell image

cquil11
and
claude
committed
fix: apply same /ix mount fix to launch_b200-nb.sh

cquil11
and
claude
committed
Drop --container-name arg from launch_b200-nb.sh

cquil11
and
claude
committed
Update dsv4 B200 SGLang launch: sglang serve + EAGLE speculative decoding

yhyang201
and
claude
committed
Add spec-decoding: mtp to dsv4-fp4-b200-sglang config

yhyang201
and
claude
committed
Add dsv4_fp4_b200_mtp.sh for spec-decoding benchmarks

yhyang201
and
claude
committed
Merge remote-tracking branch 'origin/main' into worktree-chore+dsv4-sgl-mtp-b200
cquil11
committed
Restore SGLANG_OPT_USE_CUSTOM_ALL_REDUCE_V2 / SGLANG_OPT_USE_TOPK_V2 env vars

cquil11
and
claude
committed
Split dsv4-fp4-b200-sglang-mtp search-space to match baseline plumbing

cquil11
and
claude
committed

Commits on Apr 25, 2026

Merge branch 'main' into chore/dsv4-sgl-mtp-b200
cquil11
authored

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[NVIDIA] chore: B200 single node DeepSeek v4 SGLang MTP#1145

[NVIDIA] chore: B200 single node DeepSeek v4 SGLang MTP#1145
cquil11 wants to merge 18 commits intomainfrom
chore/dsv4-sgl-mtp-b200

Commits on Apr 24, 2026

Add dsv4-fp4-b200-sglang single-node config

Switch dsv4-fp4-b200-sglang to Pro model, match vllm parallelism

Match DSV4 Pro SGLang recipe literally; port HF cache path

fix: use 'sglang serve' CLI, not python -m sglang.launch_server

fix: mount repo at /ix for deepseek-v4-blackwell image

fix: reinstall sglang from PyPI to work around masked editable install

fix: uninstall editable sglang before reinstalling from PyPI

fix: mount repo at /ix for deepseek-v4-blackwell; drop pip workaround

fix: unset baked-in CUDA_VISIBLE_DEVICES for deepseek-v4-blackwell image

fix: apply same /ix mount fix to launch_b200-nb.sh

Drop --container-name arg from launch_b200-nb.sh

Update dsv4 B200 SGLang launch: sglang serve + EAGLE speculative decoding

Add spec-decoding: mtp to dsv4-fp4-b200-sglang config

Add dsv4_fp4_b200_mtp.sh for spec-decoding benchmarks

Merge remote-tracking branch 'origin/main' into worktree-chore+dsv4-sgl-mtp-b200

Restore SGLANG_OPT_USE_CUSTOM_ALL_REDUCE_V2 / SGLANG_OPT_USE_TOPK_V2 env vars

Split dsv4-fp4-b200-sglang-mtp search-space to match baseline plumbing

Commits on Apr 25, 2026

Merge branch 'main' into chore/dsv4-sgl-mtp-b200