Search results

[RFC] Support sharding LM heads and adopting Online Softmax

enhancementNew feature or requestNew feature or request

Status: Open.

#8173 In deepspeedai/DeepSpeed;

· jinyouzhi opened on Jul 24, 2026

compute_elastic_config raises bare ZeroDivisionError for return_microbatch=True on non-0.2 elasticity versions without explicit world_size

Status: Open.

#8156 In deepspeedai/DeepSpeed;

· ErenAta16 opened on Jul 19, 2026

[BUG] AutoEP + ZeRO-1/2 universal checkpoint conversion silently leaves expert optimizer momentum stale/EP-unaware

Status: Open.

#8147 In deepspeedai/DeepSpeed;

· ErenAta16 opened on Jul 16, 2026

Add logging support for better observability

Status: Open.

#8140 In deepspeedai/DeepSpeed;

· goransh-buh opened on Jul 14, 2026

DeepSpeed - Q3 Roadmap

Status: Open.

#8104 In deepspeedai/DeepSpeed;

· PKUWZP opened on Jun 30, 2026

Consider adding a changelog to track version history

Status: Open.

#8101 In deepspeedai/DeepSpeed;

· goransh-buh opened on Jun 30, 2026

Exception type too broad in error handling

Status: Open.

#8093 In deepspeedai/DeepSpeed;

· goransh-buh opened on Jun 26, 2026

zero.Init silently does not shard (world_size=1) when the process group is uninitialized before from_pretrained -> per-rank full load -> OOM

Status: Open.

#8084 In deepspeedai/DeepSpeed;

· trevorgordon981 opened on Jun 22, 2026

zero.Init partitioning of large fused MoE-expert tensors spikes a single GPU (transient full materialization) -> OOM during load even when the sharded model fits

Status: Open.

#8085 In deepspeedai/DeepSpeed;

· trevorgordon981 opened on Jun 22, 2026

[BUG]ds_z3_config error

bugSomething isn't workingSomething isn't working

training

Status: Open.

#8076 In deepspeedai/DeepSpeed;

· whyseu opened on Jun 18, 2026

Add type hints to public API functions

Status: Open.

#8074 In deepspeedai/DeepSpeed;

· goransh-buh opened on Jun 17, 2026

EvoformerAttention should auto-detect CUTLASS instead of requiring CUTLASS_PATH

Status: Open.

#8001 In deepspeedai/DeepSpeed;

· MaxTretikov opened on May 8, 2026