[parallel] feat: Vision Data Parallel — O(1) communication alternative to patch-level SP#505

Open

aoshen524 wants to merge 5 commits intoByteDance-Seed:mainfrom

aoshen524:feat/vision-dp

Commits on Feb 24, 2026

[parallel] feat: add Vision Data Parallel as alternative to patch-level SP

aoshen524
and
claude
committed
fix: pass pre-computed patch_counts to prepare_local_vision_inputs

aoshen524
and
claude
committed

Commits on Mar 3, 2026

refactor(vision_dp): simplify docstrings, fix empty-rank backward, add contiguous guard

aoshen524
and
claude
committed
fix(vision_dp): fix Qwen3-VL deepstack NCCL deadlock on empty ranks

aoshen524
and
claude
committed
feat(vision_dp): add vision_dp flag to gate Vision DP patching

aoshen524
and
claude
committed