[WIP] Use all DTensor for Qwen3 and llama4 at TP region#2149

wwwjn wants to merge 7 commits intomainpytorch/torchtitan:mainfrom

qwen3-dtensorpytorch/torchtitan:qwen3-dtensorCopy head branch name to clipboard