Commit efa0494

and

authored

[FSDP] Support Context parallelism for FSDP using ring-flash-attn (THUDM#467)

Co-authored-by: Hecate0821 <hec4te0821@gmail.com>

1 parent 491f252 commit efa0494Copy full SHA for efa0494

3 files changed

+271

-67

lines changed

+271

-67

lines changed

Comments

(0)