[Ulysses] Carry the KV head count per DistributedAttention - #8316

Merged

delock merged 6 commits into

deepspeedai:masterfrom

alanhuangyoo:fix/ulysses-per-model-head-count

Sep 3, 2026

Commits on Aug 31, 2026

[Ulysses] Carry the KV head count per call instead of a module global
alanhuangyoo
committed
cfbeedf
Cover batch_dim_idx 1 in the GQA case
alanhuangyoo
committed
f9d0757
Move tests/unit/sequence_parallelism to tests/unit/v1
alanhuangyoo
committed
74ad9c7

Commits on Sep 1, 2026

Merge branch 'master' into fix/ulysses-per-model-head-count
delock
authored
fa7caac

Commits on Sep 2, 2026