Skip to content

[MAIN] Sync dev branch history to main to reduce branch divergence #3868

Closed
zhongbozhu wants to merge 333 commits intoNVIDIA:mainfrom
zhongbozhu:zhongbo/dev-history-sync-main
Closed

[MAIN] Sync dev branch history to main to reduce branch divergence #3868
zhongbozhu wants to merge 333 commits intoNVIDIA:mainfrom
zhongbozhu:zhongbo/dev-history-sync-main

Conversation

@zhongbozhu
Copy link
Contributor

@zhongbozhu zhongbozhu commented Mar 13, 2026

What does this PR do ?

⚠️ For major changes (either in lines of code or in its impact), please make sure to first share a design doc with the team. If you're unsure what's the best way to do so, contact the @mcore-oncall.

Contribution process

Pre-checks

  • I have added relevant unit tests
  • I have added relevant functional tests
  • I have added proper typing to my code Typing guidelines
  • I have added relevant documentation
  • I have run the autoformatter.sh on my PR

Code review

Feel free to message or comment the @mcore-oncall to help accelerate your merge into main. The less complex your PR is, the faster it will be approved and merged!

All PRs start as draft. If you open a non-draft PR, it will be automatically converted to draft.

Step 1: Mark PR as "Ready for Review"

  1. When your PR is ready, click Ready for Review.
  2. An oncall reviewer is auto-assigned and expert reviewers are notified based on your changes.
    • Some PRs may jump straight to step 2. This is determined by .github/CODEOWNERS.

⚠️ Only mark as ready once merge-conflicts are resolved and the CI is passing.
Final Review might get declined if these requirements are not fulfilled.

Step 2: Final Review

For PRs that change megatron/core, once all expert reviewers have approved, the Final Review label is applied automatically and final reviewers are assigned.

For PRs outside megatron/core, this step is skipped.

Step 3: Approved

Once all required reviewers have approved, the Approved label is applied automatically.

Merge

Any member of mcore-engineers will be able to merge your PR.

For MRs into `dev` branch The proposed review process for `dev` branch is under active discussion.

MRs are mergable after one approval by either eharper@nvidia.com or zijiey@nvidia.com.

ko3n1g and others added 30 commits October 28, 2025 12:02
@ko3n1g
Revert "cp: Megatron-FSDP Expert Parallel (DeepSeek-v3) Support int…
13edb58 
…o `dev` (NVIDIA#1987)"

This reverts commit cc33e00.
@lhb8125
[Was PR1912][Dev] feat(moe): Fine-grained activation offloading (NVID…
c22c2aa 
…IA#1969)

Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
Signed-off-by: Hongbin Liu <hongbinl@cw-dfw-cs-001-login-02.cm.cluster>
Co-authored-by: Hongbin Liu <hongbinl@cw-dfw-cs-001-login-02.cm.cluster>
@ko3n1g
ci(fix): Run tests label (NVIDIA#1970) (NVIDIA#2006)
bada8f9 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@lhb8125
Renaming golden values (NVIDIA#2020)
ccf794e 
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
@ko3n1g @yueshen2016
@shanmugamr1992 @sidsingh-nvidia @youngeunkwon0405 @shunjiad @maanug-nv @shjwudp @xuwchen @tdene
Ko3n1g/chore/sync main to dev (NVIDIA#2018)
7342f67 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: James Shen <yueshen@nvidia.com>
Co-authored-by: Chen-Han Yu <chenhany@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Mcore Bot <mcore-bot@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@shanmugamr-mlt.client.nvidia.com>
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: Youngeun Kwon <youngeunk@nvidia.com>
Co-authored-by: Shunjia Ding <shunjiad@nvidia.com>
Co-authored-by: Maanu Grover <maanug@nvidia.com>
Co-authored-by: Jack Chang <jianbinc@nvidia.com>
Co-authored-by: jianbinc <shjwudp@gmail.com>
Co-authored-by: xuwenc <xuwenc@nvidia.com>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
@ko3n1g
Ko3n1g/fix/golden values (NVIDIA#2037)
0d0f29c 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@chtruong814 @shjwudp @xuwchen
cp: Megatron-FSDP Expert Parallel (DeepSeek-v3) Support into dev (N…
1d1ac73 
…VIDIA#2007)

Signed-off-by: Charlie Truong <chtruong@nvidia.com>
Co-authored-by: Jack Chang <jianbinc@nvidia.com>
Co-authored-by: jianbinc <shjwudp@gmail.com>
Co-authored-by: xuwenc <xuwenc@nvidia.com>
@chtruong814
Update golden values due to PR NVIDIA#2007 (NVIDIA#2057)
2c85448 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@sbhavani @yaox12
Add DeepSeek-V3 GB200 NVL72 optimization guide (NVIDIA#2059)
402bc50 
Co-authored-by: Xin Yao <xiny@nvidia.com>
@ko3n1g
ci(hotfix): Disable flaky tests
4959f1f 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@buptzyb
[DEV] feat(MoE): Refactor cuda_graph_scope (NVIDIA#1917)
4008d3d 
Signed-off-by: Robin Zhang <robinz@nvidia.com>
@chtruong814
Add mirror to main workflow (NVIDIA#2042)
44539d1 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@ko3n1g @mathemakitten
ci: Remove cluster specific golden values (NVIDIA#2069)
41c6e66 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: helen ngo <helenn@nvidia.com>
@ko3n1g
ci: Disable inference test
9d05926 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@BestJuly @shifangx @Wohox
[Dev] feat(moe): Support placing MTP layers into standalone stages (N…
effebd8 
…VIDIA#1916)

Signed-off-by: Li Tao <lit@nvidia.com>
Co-authored-by: shifangx <shifangx@nvidia.com>
Co-authored-by: Pingtian Li <pingtianl@nvidia.com>
@yaox12
[Dev] A Guide to Reproduce DeepSeek-V3 Pre-training Performance on GB…
1d9edcf 
…200 (NVIDIA#1996)

Signed-off-by: Xin Yao <xiny@nvidia.com>
@yaox12
[Dev] Minor updates to the guide (NVIDIA#2103)
eb0783b 
Signed-off-by: Xin Yao <xiny@nvidia.com>
@ko3n1g
Revert "[Dev] feat(moe): Support placing MTP layers into standalone s…
ad226e4 
…tages (NVIDIA#1916)"

This reverts commit effebd8.
@ko3n1g
Reapply "[Dev] feat(moe): Support placing MTP layers into standalone …
35eeab7 
…stages (NVIDIA#1916)"

This reverts commit ad226e4.
@ko3n1g
ci: Disable broken unit
21355dd 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@cuichenx
[Dev] Fixes for gpt-oss (NVIDIA#2116)
4facf29 
Signed-off-by: Chen Cui <chcui@nvidia.com>
@BoxiangW @FDecaYed
[Dev] Support LayerWiseDistributedOptimizer with torch_dist checkpoin…
bd199dc 
…t format (NVIDIA#1928)

Signed-off-by: Boxiang Wang <boxiangw@nvidia.com>
Co-authored-by: Deyu Fu <Deyu.Foo@gmail.com>
@cuichenx
[Dev] Nemotron nano v2 vl (NVIDIA#2115)
ee14b5b 
Signed-off-by: Chen Cui <chcui@nvidia.com>
@ananthsub
[DEV] remove training dependency from megatron core for fsdp checkpoi…
09abfad 
…nt with EP (NVIDIA#2114)

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
@BestJuly
[Dev] Fix UT TestPartialCudaGraph which incorrectly set MTP in UT (N…
ec37ae3 
…VIDIA#2122)

Signed-off-by: lit <lit@nvidia.com>
@ko3n1g
ci: Restore gpt3_moe_mcore_te_tp4_ep2_etp2_pp2_scoped_cudagraph
f3cbf03 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
chore: Fix autoformatter (NVIDIA#2073) (NVIDIA#2134)
ecbfe70 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@maanug-nv
add device and dtype to empty inv_dt init (NVIDIA#2137)
79e8592 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
@sbhavani
Remove DS-V3 doc - draft being updated (NVIDIA#2155)
3c1b98e 
Signed-off-by: Santosh Bhavani <santosh.bhavani@live.com>
@FDecaYed
[DEV] torch_dist fixes, speed improvements and memory reduction for l…
b2fdd94 
…ayerwise distopt (NVIDIA#1965)

Signed-off-by: Deyu Fu <deyuf@nvidia.com>
xuwchen and others added 28 commits February 13, 2026 04:44
@xuwchen @BestJuly
[Dev] Add Qwen3-VL support with Megatron-FSDP (NVIDIA#2842)
c4b910f 
Co-authored-by: Li Tao <lit@nvidia.com>
@kunlunl
Add absorbed-mla (NVIDIA#3193)
6059f36
@chtruong814
cp: Remove gpu sanity check (NVIDIA#3420) into dev (NVIDIA#3421)
9f2ca96 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@ko3n1g
[dev] ci: Fix merge queue (NVIDIA#3385)
1dcf0da 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
[dev] cp: Cherrypick CI changes (NVIDIA#3543)
cd1c215 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Victarry
[Dev] Fix MoE aux loss tracker hang with MTP enabled (NVIDIA#3400)
aa86018
@chtruong814
ci: Remove multi-approval action from dev branch (NVIDIA#3576)
2b4b9c4 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@FDecaYed
Merge branch 'main' into dev
0ab47fa
@ko3n1g @HaochenYuan
@Phlip79 @duncanriach @yobibyte @chtruong814 @wdykas @github-actions @1195343015 @yuzhongw-nvidia @lhb8125 @youngeunkwon0405 @santhnm2 @jiemingz @tgkyrie @dimapihtar @yaox12 @rkarimimahab @sancha @deepakn94 @sbhavani @ahmadki @BestJuly @maanug-nv @mvirts @asolergi-nv @HollowMan6 @buptzyb @shengf-nv @venmugil @mathemakitten @jaredcasper @parthmannan @tdene @Autumn1998 @wplf @yashaswikarnati @nschank @Glabred @janEbert @rj42 @juntaowww @Wohox @chrisgrimm @ChenhanYu @ericharper @xiaoxi-wangfj @shjwudp @c1lovez1 @skydoorkai @yeyu-nvidia @kwyss-nvidia @jon-barker @AAnoosheh @sidsingh-nvidia @megnvidia @thecaptain789 @ISEEKYAN @xuwchen @jstjohn @lmcafee-nvidia @claude @ArEsKay3 @Victarry @cursoragent @kevalmorabia97 @shanmugamr1992 @vasunvidia @sajadn @kunlunl @laixinn @dndnda @jenchen13 @yueshen2016 @faradawn @cspades @arendu @seonjinn @sbak5 @mkhona-nvidia
[dev] pull main 260220 (NVIDIA#3574)
a1a73f8 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
Signed-off-by: Youngeun Kwon <youngeunk@nvidia.com>
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
Signed-off-by: Santosh Bhavani <santosh.bhavani@live.com>
Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: Robin Zhang <robinz@nvidia.com>
Signed-off-by: jinliangl <jinliangl@nvidia.com>
Signed-off-by: Maanu Grover <maanug@nvidia.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: xiaoxi-wangfj <690912414@qq.com>
Signed-off-by: skydoorkai <htsantaclara@163.com>
Signed-off-by: Asha Anoosheh <aanoosheh@nvidia.com>
Signed-off-by: meg miranda <mmiranda@nvidia.com>
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
Signed-off-by: sajadn <snorouzi@nvidia.com>
Signed-off-by: lit <lit@nvidia.com>
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Signed-off-by: Cory Ye <cye@nvidia.com>
Signed-off-by: adithyare <adithyare@nvidia.com>
Signed-off-by: Soumye Singhal <soumyes@cw-dfw-cs-001-dc-01.cm.cluster>
Signed-off-by: Ahmad Kiswani <kiswani.ahmad@gmail.com>
Signed-off-by: mikail <mkhona@nvidia.com>
Co-authored-by: HaochenYuan <106647990+HaochenYuan@users.noreply.github.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Duncan Riach <33532941+duncanriach@users.noreply.github.com>
Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
Co-authored-by: wdykas <73254672+wdykas@users.noreply.github.com>
Co-authored-by: root <root@gpu-h100-0348.cm.cluster>
Co-authored-by: root <root@gpu-h100-0193.cm.cluster>
Co-authored-by: root <root@gpu-h100-0082.cm.cluster>
Co-authored-by: root <root@gpu-h100-0495.cm.cluster>
Co-authored-by: William Dykas <wdykas@cw-pdx-cs-001-vscode-02.cm.cluster>
Co-authored-by: root <root@gpu-h100-0213.cm.cluster>
Co-authored-by: root <root@gpu-h100-0435.cm.cluster>
Co-authored-by: root <root@gpu-h100-0188.cm.cluster>
Co-authored-by: root <root@gpu-h100-0032.cm.cluster>
Co-authored-by: root <root@gpu-h100-0023.cm.cluster>
Co-authored-by: root <root@gpu-h100-0368.cm.cluster>
Co-authored-by: root <root@gpu-h100-0203.cm.cluster>
Co-authored-by: root <root@gpu-h100-0229.cm.cluster>
Co-authored-by: root <root@gpu-h100-0123.cm.cluster>
Co-authored-by: root <root@gpu-h100-0217.cm.cluster>
Co-authored-by: root <root@gpu-h100-0496.cm.cluster>
Co-authored-by: root <root@gpu-h100-0261.cm.cluster>
Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Yuzhong Wang <yuzhongw@nvidia.com>
Co-authored-by: Hongbin Liu <lhb8125@users.noreply.github.com>
Co-authored-by: Youngeun Kwon <youngeunk@nvidia.com>
Co-authored-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Jimmy Zhang <133159885+jiemingz@users.noreply.github.com>
Co-authored-by: tgkyrie <74066353+tgkyrie@users.noreply.github.com>
Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: rkarimimahab <rkarimimahab@nvidia.com>
Co-authored-by: Rabeeh Mahabadi <rkarimimahab@nb-hel-cs-001-vscode-02.cm.cluster>
Co-authored-by: Sanjeev Satheesh <sasatheesh@nvidia.com>
Co-authored-by: Deepak Narayanan <dnarayanan@nvidia.com>
Co-authored-by: Santosh Bhavani <santosh.bhavani@live.com>
Co-authored-by: Ahmad Kiswani <kiswani.ahmad@gmail.com>
Co-authored-by: Li Tao <lit@nvidia.com>
Co-authored-by: Maanu Grover <109391026+maanug-nv@users.noreply.github.com>
Co-authored-by: mvirts <mvirts@gmail.com>
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
Co-authored-by: ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 <hollowman@opensuse.org>
Co-authored-by: Robin Zhang <robinz@nvidia.com>
Co-authored-by: Sheng Fu <shengf@nvidia.com>
Co-authored-by: Venmugil Elango <498703+venmugil@users.noreply.github.com>
Co-authored-by: mathemakitten <helenn@nvidia.com>
Co-authored-by: Jared Casper <155158+jaredcasper@users.noreply.github.com>
Co-authored-by: Parth Mannan <38387286+parthmannan@users.noreply.github.com>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
Co-authored-by: Tong Liu <tongliu@nvidia.com>
Co-authored-by: Li Jinliang <jinliangl@nvidia.com>
Co-authored-by: Jinliang Li <jinliangl@pool0-01676.cm.cluster>
Co-authored-by: Jinliang Li <jinliangl@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
Co-authored-by: Nick Schank <nick@reflection.ai>
Co-authored-by: Jeffrey Chen <jeffrey@reflection.ai>
Co-authored-by: janEbert <janpabloe@nvidia.com>
Co-authored-by: rj42 <lbkzman@gmail.com>
Co-authored-by: Juntao Wang <juntaow@nvidia.com>
Co-authored-by: Pingtian Li <158665726+Wohox@users.noreply.github.com>
Co-authored-by: Chris Grimm <chris@reflection.ai>
Co-authored-by: Chenhan D. Yu <5185878+ChenhanYu@users.noreply.github.com>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: xiaoxi-wangfj <690912414@qq.com>
Co-authored-by: Jianbin Chang <shjwudp@gmail.com>
Co-authored-by: c1lovez1 <141424951+c1lovez1@users.noreply.github.com>
Co-authored-by: Zhang Haitao <htsantaclara@163.com>
Co-authored-by: yeyu-nvidia <yeyu@nvidia.com>
Co-authored-by: kwyss-nvidia <kwyss@nvidia.com>
Co-authored-by: Jon Barker <jbarker@nvidia.com>
Co-authored-by: Asha Anoosheh <aanoosheh@nvidia.com>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: megnvidia <mmiranda@nvidia.com>
Co-authored-by: thecaptain789 <257642323+thecaptain789@users.noreply.github.com>
Co-authored-by: thecaptain789 <thecaptain789@users.noreply.github.com>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Yan Bai <baiyan1996@icloud.com>
Co-authored-by: xuwchen <xuwenc@nvidia.com>
Co-authored-by: John St. John <jstjohn@users.noreply.github.com>
Co-authored-by: Lawrence McAfee <85179052+lmcafee-nvidia@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Robert Kirby <ArEsKay3@users.noreply.github.com>
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
Co-authored-by: Robert Kirby <rkirby@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Co-authored-by: Dennis(Zhenhuan) Liu <denliu@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
Co-authored-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
Co-authored-by: vasunvidia <108759426+vasunvidia@users.noreply.github.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
Co-authored-by: Sajad Norouzi <sajad.n@gmail.com>
Co-authored-by: Kunlun Li <94586211+kunlunl@users.noreply.github.com>
Co-authored-by: xielaixin <xielx@shanghaitech.edu.cn>
Co-authored-by: Robert Kirby <rkirby@nvidia.com>
Co-authored-by: Ming <93323717+dndnda@users.noreply.github.com>
Co-authored-by: liming127 <liming127@meituan.com>
Co-authored-by: Jon Barker <jbarker@oci-hsg-cs-001-vscode-01.cm.cluster>
Co-authored-by: helen ngo <helen.ngo14@gmail.com>
Co-authored-by: Jenny Chen <jennifchen@nvidia.com>
Co-authored-by: yueshen2016 <39203804+yueshen2016@users.noreply.github.com>
Co-authored-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
Co-authored-by: Adi Renduchintala <adithya.r@gmail.com>
Co-authored-by: Soumye Singhal <soumyes@cw-dfw-cs-001-dc-01.cm.cluster>
Co-authored-by: Seonjin Na <sna@nvidia.com>
Co-authored-by: Seonmyeong Bak <sbak@nvidia.com>
Co-authored-by: Mikail Khona (NVIDIA) <mkhona@nvidia.com>
@LiuXTao @yuzhongw-nvidia @yanring
[dev] fix(moe): fix the bug where gate was not sliced when kv_head < …
2e4a5d4 
…tp_size. (NVIDIA#3529)

Co-authored-by: xiaotaoliu <xiaotaoliu@tencent.com>
Co-authored-by: Yuzhong Wang <yuzhongw@nvidia.com>
Co-authored-by: Zijie Yan <zijiey@nvidia.com>
@kunlunl
Add unit test for THD (NVIDIA#3608)
d0e0cf0
@Victarry @claude
[Dev] feat(checkpoint): zero-copy storage sharing in CheckpointWithou…
bc9298c 
…tOutput (NVIDIA#3641)

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@xiaoyao0115 @kunlunl
[Dev] Add E2E support for THD format (NVIDIA#2924)
5c613ab 
Signed-off-by: xiaoyao0115 <1804647152@qq.com>
Signed-off-by: tailaim <tailaim@nvidia.com>
Co-authored-by: kunlunl <kunlunl@nvidia.com>
@Victarry @claude
fix: skip FSDP DTensor boundary validation under fake process group (N…
5dadaf1 
…VIDIA#3668)

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@chtruong814
ci: Remove cudagraph codeowners entry in dev branch (NVIDIA#3712)
2176c4a 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@FDecaYed @skyw
[dev] refactor to support emerging optimizers beyond muon (NVIDIA#3618)
31f5294 
Signed-off-by: Hao Wu <skyw@nvidia.com>
Co-authored-by: Hao Wu <skyw@nvidia.com>
@BestJuly
[Dev] Move some processing into a function so can be compiled (NVIDIA…
a268231 
…#3220)
@yanring @buptzyb
[Dev] Refactor MoE loss logging (NVIDIA#2569)
f983b21 
Co-authored-by: Robin Zhang <robinz@nvidia.com>
@jingqiny-99 @Victarry
[dev] feat(mHC): Add basic pytorch implementation of manifold hyper c…
0b0074e 
…onnection(mHC). (NVIDIA#2943)

Co-authored-by: Jingqin Yang <jingqiny@login-eos01.eos.clusters.nvidia.com>
Co-authored-by: root <root@eos0478.eos.clusters.nvidia.com>
Co-authored-by: Dennis Liu <denliu@nvidia.com>
@Victarry @shjwudp
[Dev] Cherry-pick: M-FSDP: Cancel erroneous grad accumulation check (N…
597f0d8 
…VIDIA#3629) (NVIDIA#3729)

Co-authored-by: Jianbin Chang <shjwudp@gmail.com>
@yuzhongw-nvidia
[dev] fix(moe): Fix DSA spec and rope. (NVIDIA#3402)
3d097e5
@eternally-z @kunlunl
Fix split_state_dict function for MoE models (NVIDIA#3667)
1edfbd6 
Co-authored-by: kunlunl <kunlunl@nvidia.com>
@huvunvidia
Exposing interleave argument for fused_apply_rotary_pos_emb_thd (NVID…
28a0aef 
…IA#3759)
@ko3n1g
build: Move fast-hadmard-transform (NVIDIA#3786)
15fb557 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@wplf
fix ddp bug when --overlap-grad-reduce and --num-distributed-optimi f…
dbf6c4c 
…or dev (NVIDIA#3694)
@xiaoyao0115
[Dev] Fix for rope when enabling THD + Dynamic-CP; and use the naming…
cde56a4 
… Dynamic-CP. (NVIDIA#3405)

Signed-off-by: xiaoyao0115 <1804647152@qq.com>
@skyw
Continue emerging optimizer refactoring (NVIDIA#3737)
9374a4d 
Signed-off-by: Hao Wu <skyw@nvidia.com>
@zhongbozhu
Merge branch 'dev' into zhongbo/dev-history-sync-main
7375147
@copy-pr-bot
Copy link

copy-pr-bot bot commented Mar 13, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@zhongbozhu zhongbozhu closed this Mar 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.