Add support for context parallelism#1299

Open

bclyang wants to merge 2 commits intomainfrom

add-context-parallel-support

Commits on Oct 1, 2024

Add context parallelism support
bclyang
committed

Commits on Jan 29, 2025

Merge branch 'main' of https://github.com/EleutherAI/gpt-neox into add-context-parallel-support
Quentin-Anthony
committed