feat(vision): add Vision DP for parallel ViT computation across Ulysses SP ranks#357

Open

aoshen524 wants to merge 8 commits intoalibaba:mainfrom

aoshen524:feat/vision-dp-ulysses

Commits on Feb 26, 2026

feat(vision): add Vision DP for parallel ViT computation across Ulysses SP ranks

aoshen524
and
claude
committed
fix(vision_dp): fix gradient routing, load balancing, and efficiency issues

aoshen524
and
claude
committed

Commits on Mar 3, 2026

refactor(vision_dp): simplify docstrings, fix empty-rank backward, add contiguous guard

aoshen524
and
claude
committed
fix(vision_dp): fix Qwen3-VL deepstack NCCL deadlock on empty ranks

aoshen524
and
claude
committed
feat(vision_dp): add vision_dp flag to gate Vision DP patching

aoshen524
and
claude
committed

Commits on Mar 4, 2026

Commits on Mar 5, 2026

feat(vision_dp): add FSDP2 strategy support for Vision DP

aoshen524
and
claude
committed