User problem
NCCL 2.29.3 CE based AG doesn't overlap with fprop, so we cannot enable MFSDP+nccl_ub for 405B.
Desired outcome
Above bug is fixed in 2.30
Alternatives considered
No response
Affected area
area:perf
Urgency / use case
Important but not blocking
Extra context
No response
User problem
NCCL 2.29.3 CE based AG doesn't overlap with fprop, so we cannot enable MFSDP+nccl_ub for 405B.
Desired outcome
Above bug is fixed in 2.30
Alternatives considered
No response
Affected area
area:perf
Urgency / use case
Important but not blocking
Extra context
No response