-
Notifications
You must be signed in to change notification settings - Fork 963
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[DO NOT review yet, pending final cleanup] Expert Parallelism support for Kimi K3
CLA Signed
This label is managed by the Meta Open Source bot.
[DO NOT review yet, pending final cleanup] Context Parallelism support for Kimi K3 (text LLM side): KDA Context Parallelism (KCP) and MLA Ulysses
CLA Signed
This label is managed by the Meta Open Source bot.
[DO NOT review yet, pending final cleanup] Pipeline Parallelism support for Kimi K3 (text LLM side): PP Virtual Stage Cache Adapter for Attention Residual
CLA Signed
This label is managed by the Meta Open Source bot.
[ci] fix transformers backend test arguments
CLA Signed
This label is managed by the Meta Open Source bot.
[ci] Fix SFT Real-PG numerics and restore full 8-GPU trigger
ciflow/8gpu
CLA Signed
This label is managed by the Meta Open Source bot.
#4304
opened Aug 24, 2026 by
wwwjn
Contributor
Loading…
Raise clear errors when validation yields zero batches or zero valid tokens
CLA Signed
This label is managed by the Meta Open Source bot.
#4301
opened Aug 24, 2026 by
shoemoney
Loading…
Fix mfu calculation for muse glimmer and gpt_oss
CLA Signed
This label is managed by the Meta Open Source bot.
#4300
opened Aug 23, 2026 by
jinsooihm
Contributor
Loading…
[Bug] Use actual step window for end-to-end timing
CLA Signed
This label is managed by the Meta Open Source bot.
#4298
opened Aug 23, 2026 by
taking-lying-flat
Contributor
Loading…
[Bug] Match checkpoint directory names exactly
CLA Signed
This label is managed by the Meta Open Source bot.
#4292
opened Aug 23, 2026 by
taking-lying-flat
Contributor
Loading…
[Release RFC] Release process and add staged RC GPU validation
CLA Signed
This label is managed by the Meta Open Source bot.
#4290
opened Aug 22, 2026 by
acisseJZhong
Contributor
Loading…
Preserve requires_grad in SimpleFSDP parameter registration
CLA Signed
This label is managed by the Meta Open Source bot.
#4282
opened Aug 22, 2026 by
sylvesterkaczmarek
Contributor
Loading…
[DO NOT MERGE, pending rebase and sequential smaller PRs after eager-model merge] Kimi K3: full tree with 5D parallelism multimodal, LoRA, MoonViT Dynamic CP&DEP, MXFP4/MXFP8 QAT, quantile balancing
CLA Signed
This label is managed by the Meta Open Source bot.
[DistMuon] Batch compatible local matrix updates
CLA Signed
This label is managed by the Meta Open Source bot.
[checkpoint] Log native DCP async save durations
CLA Signed
This label is managed by the Meta Open Source bot.
#4279
opened Aug 22, 2026 by
ivy-zhou
Contributor
Loading…
[checkpoint] Centralize checkpoint trace spans
CLA Signed
This label is managed by the Meta Open Source bot.
#4278
opened Aug 22, 2026 by
ivy-zhou
Contributor
Loading…
[checkpoint] Load Hugging Face checkpoints natively
CLA Signed
This label is managed by the Meta Open Source bot.
#4277
opened Aug 22, 2026 by
ivy-zhou
Contributor
Loading…
[synthetic-data] Add on-the-fly synthetic length-distribution dataset
CLA Signed
This label is managed by the Meta Open Source bot.
#4275
opened Aug 21, 2026 by
jinsooihm
Contributor
Loading…
[DistMuon] Drop the foreach-copy compatibility fallback
CLA Signed
This label is managed by the Meta Open Source bot.
[checkpoint] Wait for async saves during close
CLA Signed
This label is managed by the Meta Open Source bot.
#4270
opened Aug 21, 2026 by
taking-lying-flat
Contributor
Loading…
Generalize DCP state dict adapters
ciflow/rl
CLA Signed
This label is managed by the Meta Open Source bot.
upgrade spmd_types to 0.2.5, remove SpmdLayout
ciflow/rl
CLA Signed
This label is managed by the Meta Open Source bot.
#4265
opened Aug 21, 2026 by
pianpwk
Contributor
Loading…
[Don't review] Coda flex gemm passes
CLA Signed
This label is managed by the Meta Open Source bot.
#4264
opened Aug 21, 2026 by
SherlockNoMad
Contributor
•
Draft
[Kimi] Convert the tiktoken vocabulary at download time
CLA Signed
This label is managed by the Meta Open Source bot.
Previous Next
ProTip!
Follow long discussions with comments:>50.