TorchFT 8 GPU Integration Test #4950

Job	Run time
set-matrix / set	5s
build-test (cuda, linux.g5.48xlarge.nvidia.gpu, cuda, 13.0, torchtitan-ubuntu-22.04-clang12, http... / linux-job	9m 45s
	9m 50s

Provide feedback