Issues

Pipeline parallelism support for qwen3_moe

enhancement

#1763

· fretnoyz opened

on Aug 19, 2026

mlx_lm.server never clears MLX's buffer pool on model swap, retaining every model it has loaded

bug

#1757

· j7t8t9gyw6-tech opened

on Aug 18, 2026

Distributed JACCL server crashes when two requests arrive concurrently

#1737

· nachogala opened

on Aug 15, 2026

Code in the first example for Python SDK do not pass type check on load()'s returned values

#1732

· rija opened

on Aug 14, 2026

make_shards prepends an empty shard when the first tensor exceeds the size limit

#1720

· FU-max-boop opened

on Aug 13, 2026

Fused Metal KL-divergence kernel overflows (−3.39e38) in backward pass during DWQ for models >~1B

#1700

· yamyr opened

on Aug 10, 2026

gemma3n broken with batch KV caches: cache.state unpack crash + RoPE offset mutated in place across update_and_fetch

#1699

· Cyb3rb1ade opened

on Aug 9, 2026

gemma3n: KV-shared layers only reuse cached KV when a cache is present, so no-cache forward (LoRA training, evaluation) diverges from generation

#1674

· binaydhakal opened

on Aug 7, 2026

mlx_lm.server: [metal::malloc] Resource limit (499000) exceeded in BatchGenerator._generate wedges the server invisibly (HTTP layer stays up, generation thread dies) — recurrence of #831/#1185/#1332's signature in continuous batched serving

#1672

· athal7 opened

on Aug 7, 2026

Confusing bare KeyError when LoRA config uses "alpha" instead of "scale"

#1670

· arjunneema09 opened

on Aug 7, 2026

mlx_lm.generate: repetition_penalty has no default (unlike other sampling params), model can loop into repeated text with no warning

#1669

· arjunneema09 opened

on Aug 7, 2026

completeMemory() prepare count underflow kernel panic recurs under continuous batching despite #883's KV-cache-bound mitigations

#1666

· athal7 opened

on Aug 5, 2026

Navigation Menu

Uh oh!

All issues

Pipeline parallelism support for qwen3_moe

mlx_lm.server never clears MLX's buffer pool on model swap, retaining every model it has loaded

Distributed JACCL server crashes when two requests arrive concurrently

Code in the first example for Python SDK do not pass type check on load()'s returned values

make_shards prepends an empty shard when the first tensor exceeds the size limit

Fused Metal KL-divergence kernel overflows (−3.39e38) in backward pass during DWQ for models >~1B

gemma3n broken with batch KV caches: cache.state unpack crash + RoPE offset mutated in place across update_and_fetch

gemma3n: KV-shared layers only reuse cached KV when a cache is present, so no-cache forward (LoRA training, evaluation) diverges from generation

mlx_lm.server: [metal::malloc] Resource limit (499000) exceeded in BatchGenerator._generate wedges the server invisibly (HTTP layer stays up, generation thread dies) — recurrence of #831/#1185/#1332's signature in continuous batched serving

Confusing bare KeyError when LoRA config uses "alpha" instead of "scale"

mlx_lm.generate: repetition_penalty has no default (unlike other sampling params), model can loop into repeated text with no warning

completeMemory() prepare count underflow kernel panic recurs under continuous batching despite #883's KV-cache-bound mitigations

Uh oh!

Search results