Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 6511 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6511 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0
Copy link
Collaborator

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

No description provided.

@RaymondLi0 RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0 RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
tdene and others added 28 commits February 11, 2026 16:23
@tdene
Add simple GRPO functional test (#3323)
b5d50cb
@ko3n1g
ci: Concurrency control for merge-queue (#3353)
1c245c7 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@chtruong814
ci: Update golden value download script to work with Github (#3335)
d9f075c 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@megnvidia
Removing etc from main index page, shifted name of discussions (#3271)
d0b768f 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
@thecaptain789 @Phlip79
fix: correct typos 'seperated' and 'recieved' (#3305)
7d1acf6 
Co-authored-by: thecaptain789 <thecaptain789@users.noreply.github.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@shengf-nv
Improved PyTorch profiler and added PyTorch execution trace (#3273)
2807a4e
@ko3n1g
build: Bump TE on 2.12 (#3371)
1959739 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci(hotfix): job conditions (#3376)
f06e669 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
6467cbc
@sidsingh-nvidia @ISEEKYAN
Record moe routing decisions during inference. (#3034)
faced51 
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Yan Bai <baiyan1996@icloud.com>
@Wohox @dimapihtar
[Main] Fix EP Overlap Bugs for Full-Iter CG (#3164)
dedb6dd 
Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com>
@maanug-nv
Avoid direct pickle import (#3375)
11a4659 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
@Phlip79
Delete old pretrain_* files (#3359)
fe9279e
@xuwchen
Add Qwen3-VL support with Megatron-FSDP (#2841)
7df15bd
@santhnm2
Refactor Mamba chunked prefill (#3265)
c65fb25 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@jstjohn @ko3n1g
Improved parallel logging of learning rate (#3319)
47938af 
Co-authored-by: oliver könig <okoenig@nvidia.com>
@lmcafee-nvidia @claude
Add enhanced event tracking with TTFT measurement and compact seriali…
a51c1c8 
…zation. (#3253)

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
@santhnm2
Add assertion that max_requests is divisible by tp_size (#3304)
dbc444f 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@ArEsKay3 @ISEEKYAN
@sidsingh-nvidia @ko3n1g @tdene
Move to using the Inference OpenAI API server (#3107)
1123fc0 
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Yan Bai <baiyan1996@icloud.com>
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
Co-authored-by: Robert Kirby <rkirby@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
@ko3n1g
Revert "Move to using the Inference OpenAI API server (#3107)"
4184bfa 
This reverts commit 1123fc0.
@Victarry @cursoragent @Phlip79
Update moe github test cases. (#3077)
9119fae 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@ko3n1g
Revert "Update moe github test cases. (#3077)"
e0aa16b 
This reverts commit 9119fae.
@nschank @ko3n1g @yashaswikarnati
Split layer_specs to return Submodules instead of ModuleSpecs (#3255)
28ccdaa 
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
@chtruong814
ci: Remove gpu sanity check (#3420)
76a9f47 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@kevalmorabia97
[Critical-Bug] Fix Uneven PP for Mamba models (Nemotron3-nano) (#3399)
d10eb6f 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
@shanmugamr1992
Fix for rl (#3390)
2611830
@vasunvidia
Add check for full_iteration scope before instantiating CudaGraphMana…
4578ed8 
…ger (#3362)
@megnvidia @Phlip79
Fix broken links throughout (#3230)
698feec 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
github-actions bot and others added 30 commits March 11, 2026 09:16
@github-actions
chore: rotate oncall schedule
07e512a
@yobibyte
Improve error logging when invalid number of tokens is requested. (#3680
e20b89a 
)
@jenchen13
Add NVIDIA-Nemotron-3-Super-120B-A12B-BF16 to ModelOpt examples (#3805)
5bc89f3
@ko3n1g
build: Bump TE2.13 (#3800)
da46946 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@jalbericiola @mathemakitten
Ensure dummy_forward does not attempt to run cudagraphs (#3789)
8e64e69 
Co-authored-by: mathemakitten <helen.ngo14@gmail.com>
Co-authored-by: Helen Ngo <helenn@nvidia.com>
@santhnm2 @shanmugamr1992
Add speculative decoding support with MTP layers (#3594)
8f539df 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>
@shanmugamr1992 @tdene
@ArEsKay3 @i-riyad
Shanmugamr1992/megatron inference ultra (#3784)
39472d8 
Co-authored-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Co-authored-by: Robert Kirby <rkirby@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: rislam <rislam@nvidia.com>
@shjwudp @claude
Fix backward compatibility issue with MFSDP --grad-reduce-in-bf16 (#…
d997820 
…3799)

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
@sbak5 @claude
feat: add NCCL flight recorder configuration support (#3806)
251a754 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g
Revert "Ensure dummy_forward does not attempt to run cudagraphs (#3789)…
5a3aa17 
…" (#3834)
@tdene @santhnm2
Fix if statement in main (#3833)
5b25326 
Co-authored-by: Keshav Santhanam <ksanthanam@nvidia.com>
@ko3n1g
Update golden values of weekly tests (#3829)
6657173 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
build: Loosen TE restriction (#3827)
4736aed 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g @salmanmkc
Upgrade GitHub Actions for Node 24 compatibility (#3830)
1d5e68b 
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
@tdene
Do not let chunked prefill generate decode logprobs (#3777)
46227e0
@tdene
Prevent double serialization inside Flask server (#3653)
e08dc9d
@tdene
Allow RL to run inference-only via skip-train (#3744)
29e798a
@ko3n1g
Announce Python 3.12 migration (#3825)
4c1d0e4 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
fabbcdf
@chtruong814
ci: Skip test_wrong_cuda_graph_impl_returns_false in LTS (#3847)
b250472 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@chtruong814
ci: Mark TestCoordinator.test_throughput as flaky (#3849)
7ca9dc5 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@dimapihtar
find optimal number of workers (#3699)
f261906 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@dimapihtar
remove encoder_and_decoder (#3836)
b7437fe 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@chtruong814
ci: Skip more tests in test_vision_cuda_graphs for LTS (#3860)
8a806e5 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@mathemakitten
Ensure that inference dummy_forward does not try to match on a cudagr…
90fee1f 
…aph when running eager (#3815)
@santhnm2 @shanmugamr1992
Add unit tests for speculative decoding (#3817)
d1b8e27 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>
@tdene
Fix flakiness due to timing between shutdowns (#3857)
d4ac04f
@huvunvidia
Exposing interleave argument for fused_apply_rotary_pos_emb_thd (#3794)
87eb3c2
@ko3n1g @claude @chtruong814
ci: install nvidia-resiliency-ext from source (#3861)
9a19203 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
@santhnm2
Miscellaneous inference bug fixes (#3840)
f8becec 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.