Commit 6d3b33f

and

authored

[FSDP] Support Context parallelism for FSDP using ring-flash-attn (#467)

Co-authored-by: Hecate0821 <hec4te0821@gmail.com>

1 parent d4e3af7 commit 6d3b33fCopy full SHA for 6d3b33f

3 files changed

+271

-67

lines changed

+271

-67

lines changed

Comments

(0)