Skip to content

[AMD] ci: enable the GPT-OSS 20B MoE LoRA e2e on ROCm - #2541

Draft
XinyuJiangCMU wants to merge 4 commits into
radixark:mainfrom
XinyuJiangCMU:amd/enable-gpt-oss-moe-lora-rocm-20260814
Draft

[AMD] ci: enable the GPT-OSS 20B MoE LoRA e2e on ROCm#2541
XinyuJiangCMU wants to merge 4 commits into
radixark:mainfrom
XinyuJiangCMU:amd/enable-gpt-oss-moe-lora-rocm-20260814

Conversation

@XinyuJiangCMU

Copy link
Copy Markdown
Contributor

Co-author-with: @JessicaJiang-123

Summary

Register tests/e2e/megatron/model_scripts/test_gpt_oss_20b_moe_lora_ci.py on the ROCm stage-c-4-gpu-mi350 suite. The test is otherwise unchanged; both serving combinations already run as written.

The one behaviour change is that ROCm selects SGLang's triton attention backend, gated on MILES_HARDWARE_PLATFORM. ROCm otherwise defaults to aiter, which ships no compiled batch-prefill kernel for what gpt-oss-20b needs: a learned attention sink, a KV cache large enough to require the global-load variant, and page_size=1 below the kernel's tile width. That variable is only set in docker/Dockerfile.rocm, so the argument string is empty on every CUDA image and the composed args are byte-identical there. The CUDA registration is untouched.

Verification

Ran the test end to end on 4x MI355X with both dependencies below applied. Each combination completed and the Ray job reported success:

combo PASSED: shared-outer + virtual-experts
combo PASSED: per-expert + no-virtual-experts
update_weights phase=end ok=true elapsed_s=4.6
Job 'raysubmit_wmNUyY7nFiEgEPcu' succeeded

collect_tests(discover_ci_files(), sanity_check=True) returns both a HWBackend.CUDA entry on stage-c-4-gpu-h200 and a HWBackend.ROCM entry on stage-c-4-gpu-mi350 for this file, and pre-commit run passes.

Dependencies

Merge this last; ahead of either one it turns the mi350 suite red.

Register the existing test on the mi350 4-GPU suite and select SGLang's triton
attention backend there, since aiter ships no batch-prefill kernel for this
model's sink and page-size combination.

Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
@XinyuJiangCMU
XinyuJiangCMU marked this pull request as draft August 14, 2026 20:03
XinyuJiangCMU and others added 3 commits August 14, 2026 20:03
Register tests/fast-gpu/test_fsdp_hybrid_shard.py on the mi350 4-GPU suite.
The test itself is unchanged and needs no ROCm-specific arguments.

Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
…lies

Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant