Skip to content

Update fork#34

Open
AleHD wants to merge 3203 commits into
swiss-ai:mainfrom
NVIDIA:main
Open

Update fork#34
AleHD wants to merge 3203 commits into
swiss-ai:mainfrom
NVIDIA:main

Conversation

@AleHD
Copy link
Copy Markdown
Collaborator

@AleHD AleHD commented Feb 14, 2025

Opening this PR to track changes done upstream.

@TJ-Solergibert TJ-Solergibert self-assigned this Mar 18, 2025
@AleHD AleHD mentioned this pull request Apr 10, 2025
Closed
Phlip79 and others added 28 commits April 14, 2026 06:15
@Phlip79 @claude
Fix stale approvals (#4280)
cd03c3e 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@yaox12
[MoE] Add a new score function to the router (#3673)
eb80b74 
Signed-off-by: Xin Yao <xiny@nvidia.com>
@Victarry @claude
[MoE] Improvement of shared expert overlap, support shared expert ove…
ebfa138 
…rlap for FlexDispatcher (#2207)

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@ko3n1g @claude
build: bump DeepEP to 34152ae (#4228)
123645b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g @claude
ci: mark test_fused_indexer_loss_gradient_tp_consistency as flaky_in_…
3d7a701 
…dev (#4299)

Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@cspades
Fix typo in PR4133. (#4277)
4cef23c 
Signed-off-by: Cory Ye <cye@nvidia.com>
@ko3n1g @claude
ci: add retry loop to apt-get update to handle transient mirror sync …
bcec618 
…failures (#4209)

Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g @claude
fix: enforce correct pass thresholds for deterministic and approximat…
4e85d74 
…e tests (#4238)

Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@dimapihtar
remove legacy biencoder and realm models (#4205)
d245c44 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@ko3n1g @claude
ci: add configurable launcher support for functional tests (ft_launch…
6636eb0 
…er / torchrun) (#4298)

Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g @claude
chore: document --target main for local Docker builds (#4307)
d530a04 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@maanug-nv @claude
Extract args init to launch scripts (#4225)
97aca2f 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
@BestJuly @claude
[Main] Fix TE version check for retain_pinned_cpu_buffers in cpu offl…
c2d1a8f 
…oad (#4267)

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions
chore: rotate oncall schedule
b342602
@janEbert
Fix documented shape (#3486)
1d344ae
@ko3n1g
ci: add sync-skills workflow, rename CLAUDE.md → AGENTS.md, move .cla…
4a79536 
…ude/skills → skills/ (#4303)

Signed-off-by: oliver könig <okoenig@nvidia.com>
@github-actions
chore(beep boop 🤖): symlink skills/ → .claude/skills, .agents/skills …
57fc3ae 
…and AGENTS.md → CLAUDE.md
@shifangx
Get device correctly when module returns a dict instead of individu…
23265d2 
…al tensor (#4265)
@dimapihtar
remove vision legacy code (#4202)
e69cf43 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@ko3n1g @claude
feat: long convergence resiliency for release tests (#4335)
f098fe8 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g @claude
ci(action): improve GitHub Actions output UX (#4337)
8681ebb 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g @claude
build: bump TransformerEngine to release_v2.14 (#4331)
ceac269 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g @claude
feat: add create-issue skill (#4338)
efbe7a1 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ko3n1g
Set megatron-fsdp to 0.5.0
97f9ab6
@shifangx
M4 leftover for TE cuda graph (#3137)
01eb7e8
@ZhiyuLi-Nvidia
fix: wait for async P2P send before deallocating output tensor (#4047)
260cba7
@ko3n1g @claude
ci(gb200): add 1-node mr-github functional test variants (#4334)
2aeaf56 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: Oliver Koenig <okoenig@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@ezioliao @ericharper @deepakn94
Fix potential coredump issue that occurs when saving a checkpoint (#1871
ded22f4 
)

Co-authored-by: liaoyang <yliao@siflow.cn>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: Deepak Narayanan <deepakn94@gmail.com>
kevalmorabia97 and others added 30 commits May 14, 2026 19:57
@kevalmorabia97
Bump nvidia-modelopt>=0.44.0 (#4803)
98031e1 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
@Phlip79
Update owners (#4794)
266562f
@balasaajay
ci: Update workflow to use same commit for building docker image and …
e9a0930 
…running tests (#4787)
@balasaajay
chore: Update nightly tests golden values (#4805)
a53107c
@sidsingh-nvidia
Inference: Optimize Prefill Engine Steps for Nemotron (#4764)
9b4074b
@lichenlu @peibli @dimapihtar
Strengthen test_checkpoint to verify distributed checkpoint behavior (#…
493e2be 
…4711)

Co-authored-by: peibli <lipeibao@126.com>
Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com>
@Connor-XY @ksivaman
@claude @yaox12 @claude @gdengk @zhongbozhu
Combine GEMM + SwiGLU fused MLP PRs (3890, 4071, 4095, 4219, 4311, 43…
6815c0f 
…24) → main (#4636)

Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Signed-off-by: ksivamani <ksivamani@nvidia.com>
Signed-off-by: Xin Yao <xiny@nvidia.com>
Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com>
Co-authored-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Gao Deng <160076886+gdengk@users.noreply.github.com>
Co-authored-by: Gao Deng <gdeng@login-lyris02.lyris.clusters.nvidia.com>
Co-authored-by: Zhongbo Zhu <42691305+zhongbozhu@users.noreply.github.com>
@asolergi-nv
Disable MSC by default; opt in via --enable-msc (#4629)
95bba94
@pavelgein @asolergi-nv
[fix] Use MSC for checking checkpoint existence (#4251)
f2070ee 
Signed-off-by: Pavel Gein <pavel.gein@gmail.com>
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
@balasaajay
ci: tolerate git-gc race in /home/runner chown after checkout (#4808)
b3b6719
@gdengk
Reorder mtp_post_process after attention backward in 1F1B schedule pl…
212f885 
…an (#4695)

Co-authored-by: Gao Deng <gdeng@login-lyris01.lyris.clusters.nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
f92a207
@dimapihtar @claude
additional tests for nvrx (#4522)
f9952cb 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
@Wohox
[Main][feat] Support A2A Overlap for Megatron-FSDP (#3797)
e9d9a4c
@xrennvidia @Phlip79
add is_torch_min_version in fsdp src (#4812)
7371e01 
Signed-off-by: Xiaowei Ren <xren@nvidia.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@gdengk @ericharper @Phlip79
Add high-priority A2A stream and HybridEP preprocessing SMs (#4694)
54f90af 
Co-authored-by: Gao Deng <gdeng@login-lyris02.lyris.clusters.nvidia.com>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@buptzyb @claude
Refactor CUDA graph API: decompose cuda_graph_scope into full_iterati…
e41b370 
…on impl, inference scope, and per-layer capture modules (#4292)

Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@github-actions
chore(beep boop 🤖): Bump (main) (2026-05-18)
a1c5f5d
@dimapihtar
Tokenizers updates (#4780)
ab28544 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@dimapihtar
Fix no nvrx tests (#4847)
5096459 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@yashaswikarnati
Thread custom process groups through MoE grad finalization (#4782)
aa786b7
@shanmugamr1992 @claude
Fix unit tests (#4689)
648b916 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@shanmugamr1992 @claude @chtruong814
Tests/dynamic inference functional coverage (#4761)
6c3fa6d 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
74daec9
@janEbert
Fix oncall references (#4722)
952efb4
@balasaajay
Update golden values for nightly functional tests (#4850)
b2a8ec7
@athitten
fix(inference): size DynamicInferenceContext KV layer_map for non-uni…
43fb2f5 
…form PP (#4775)

Co-authored-by: Abhishree Thittenamane <athittenaman@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: root <root@pool0-01849.cm.cluster>
@kevalmorabia97
Modernize post-training modelopt example scripts (#4807)
14aaa7e 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
@github-actions
chore: rotate oncall schedule
38986a9
@shanmugamr1992 @claude
test: add inference performance test harness for GPT 583M, hybrid 2B,… (
23ba357 
#4806)

Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@TJ-Solergibert TJ-Solergibert

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.