Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
319 Open 1,965 Closed
319 Open 1,965 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

DDP refactoring: Extract parameter layout computation into optimizer classmethod
#3812 opened Mar 11, 2026 by deepakn94 • Draft
2
Tensor statistic collection via NVIDIA-DLFW-Inspect & TE debug modules
#3811 opened Mar 11, 2026 by paul-gibbons • Draft
1 of 5 tasks
1
Support 'auto' argument which defaults to pre-MixedPrecisionPolicy be… complexity: low
#3810 opened Mar 11, 2026 by cspades Loading…
5 tasks
Core 0.16
@cspades
2
docs: add spectral descent / muon article to docs/discussions docs-only documentation only (docs or docstrings)
#3809 opened Mar 11, 2026 by sbhavani Loading…
1 of 5 tasks
1
[TESTING] Speculative decoding with no unit tests
#3808 opened Mar 11, 2026 by santhnm2 • Draft
5 tasks
Core 0.16
3
[DO NOT MERGE] MLPERF HOTFIX: Default gradient communication dtype to BF16.
#3807 opened Mar 11, 2026 by cspades • Draft
5 tasks
@cspades
1
feat: add NCCL flight recorder configuration support complexity: low
#3806 opened Mar 11, 2026 by sbak5 Loading…
5 tasks
7
Fix backward compatibility issue with MFSDP --grad-reduce-in-bf16 complexity: low Expert Review Apply this label to indicate that your PR is ready for expert review. module: megatron-fsdp
#3799 opened Mar 11, 2026 by shjwudp Loading…
5 tasks
Core 0.16
@shjwudp
6
(draft)[Main][feat] Support A2A Overlap for Megatron-FSDP
#3797 opened Mar 11, 2026 by Wohox • Draft
5 tasks
1
(Draft)[Dev][feat] Support A2A Overlap for Megatron-FSDP
#3796 opened Mar 11, 2026 by Wohox • Draft
5 tasks
1
(Draft)[Main][feat] Support overlapping A2A Combine backprop with wgrad GEMM
#3795 opened Mar 11, 2026 by Wohox • Draft
2 of 7 tasks
3
Exposing interleave argument for fused_apply_rotary_pos_emb_thd complexity: low Final Review PR is in the "final review" stage
#3794 opened Mar 11, 2026 by huvunvidia Loading…
5 tasks
Core 0.16
2
Update Dynamic CP to support sequence packing, MXFP8 and Mamba
#3791 opened Mar 11, 2026 by parthmannan • Draft
5 tasks
1
docs: Update Latest News in README.md docs-only documentation only (docs or docstrings)
#3790 opened Mar 10, 2026 by sbhavani Loading…
1 of 5 tasks
3
Add parallel MLA inference tests, fix corresponding issues
#3787 opened Mar 10, 2026 by janEbert • Draft
1
Fix bug in EP sync for Mamba models
#3785 opened Mar 10, 2026 by santhnm2 • Draft
5 tasks
4
Shanmugamr1992/megatron inference ultra Approved All necessary approvals have been made complexity: medium
#3784 opened Mar 10, 2026 by shanmugamr1992 Loading…
5 tasks
Core 0.16
9
Add batch invariant grouped gemm kernel for inference complexity: medium
#3783 opened Mar 10, 2026 by santhnm2 Loading…
5 tasks
5
Fix PersistentAsyncCaller.__del__ crash during Python shutdown community-request
#3781 opened Mar 10, 2026 by cluster2600 Loading…
1 of 3 tasks
1
4
Megatron inference ultra merge into main
#3780 opened Mar 10, 2026 by shanmugamr1992 • Draft
5 tasks
2
Custom step batch size rampup schedules complexity: medium Final Review PR is in the "final review" stage
#3779 opened Mar 10, 2026 by mkhona-nvidia Loading…
5 tasks
@mkhona-nvidia
2
Do not let chunked prefill generate decode tokens complexity: low Final Review PR is in the "final review" stage
#3777 opened Mar 10, 2026 by tdene Loading…
5 tasks
Core 0.16
4
Track errors through the inference return path Final Review PR is in the "final review" stage
#3776 opened Mar 10, 2026 by tdene Loading…
5 tasks
Core 0.16
18
Make nemotron6 config take --expert-tensor-parallel-size from ETP env.
#3772 opened Mar 10, 2026 by yobibyte Loading… Core 0.16
3
chore: remove nv-grouped-gemm dependency community-request
#3770 opened Mar 10, 2026 by liuyun7345 Loading…
1
2
ProTip! Mix and match filters to narrow down what you’re looking for.