Commit 92531e0
File tree
213 files changed
+122621
-81666
lines changed- .github
- actions
- workflows
- docs
- get-started
- user-guide
- examples
- gptoss
- inference/gpt
- mimo
- data
- model_providers
- scripts
- post_training/modelopt
- conf
- nvidia
- openai
- rl
- environments/math
- model_configs
- megatron
- core
- dist_checkpointing/strategies
- distributed/fsdp/src/megatron_fsdp
- extensions
- inference
- contexts
- attention_context
- engines
- model_inference_wrappers
- quantization
- text_generation_controllers
- text_generation_server
- dynamic_text_gen_server
- endpoints
- models
- common/embeddings
- gpt
- mamba
- mimo
- config
- model
- partition
- pipeline_parallel
- resharding
- nvshmem_copy_service
- core
- ssm
- ops
- tensor_parallel
- transformer
- experimental_attention_variant
- moe
- inference
- rl
- inference
- training
- config
- tests
- functional_tests
- python_test_utils
- test_cases
- bert
- bert_mcore_tp1_pp2
- bert_mcore_tp1_pp4_vp2
- bert_mcore_tp2_pp2_local_spec
- bert_mcore_tp2_pp2_resume_torch_dist_local_spec
- bert_mcore_tp2_pp2_resume_torch_dist
- bert_mcore_tp2_pp2
- bert_mcore_tp4_pp1
- bert_release_sm
- gpt
- gpt3_15b_8t_release_gb200
- gpt3_15b_8t_release_sm_gb200
- gpt3_15b_8t_release_sm
- gpt3_weekly_mcore_tp2_pp2_current_scaling_native_fp8_tp_pp_sp_tp_overlap
- gpt3_weekly_mcore_tp4_cp2_current_scaling_native_fp8_tp_sp_cp_tp_overlap
- hybrid/hybrid_dynamic_inference_tp1_pp1_dp8_583m_chunked_prefill
- mimo
- mimo_vlm_pretrain_convergence_tp1_pp1_cp1_dp8_seq_packing
- mimo_vlm_pretrain_convergence_tp1_pp1_cp2_dp8
- mixtral
- deepseekv3_proxy_flex_tp1pp4emp16etp1cp1_gb_200_release_sm
- deepseekv3_proxy_flex_tp1pp4emp16etp1cp1_release_sm
- deepseekv3_proxy_flex_tp2pp2emp16etp1cp1_gb_200_release_sm
- deepseekv3_proxy_flex_tp2pp2emp16etp1cp1_gb_200_release
- mixtral_8x22b_tp2pp8ep8vpp1_release
- mixtral_8x7b_tp1pp4ep8vpp8_release
- moe
- gpt3_mcore_te_tp2_pp1_te_8experts2parallel_ddp_average_in_collective
- gpt3_mcore_te_tp2_pp1_te_8experts2parallel_overlap_grad_reduce_param_gather_groupedGEMM
- gpt3_mcore_te_tp2_pp1_te_a2a_ovlp_8experts_etp1_ep4
- gpt3_moe_mcore_te_ep8_resume_torch_dist_dist_muon
- gpt3_moe_mcore_te_ep8_resume_torch_dist_dist_optimizer
- gpt3_moe_mcore_te_ep8_resume_torch_dist_muon
- gpt3_moe_mcore_te_tp2_pp2_ep4_etp1_fine_grained_offloading
- gpt3_moe_mcore_te_tp2_pp2_ep4_etp1_no_mtp_no_a2a_ovlp_fine_grained_offloading
- gpt3_moe_mcore_te_tp4_ep2_etp2_pp2_resume_torch_dist_dist_optimizer
- gpt3_moe_mcore_te_tp4_ep2_etp2_pp2_scoped_cudagraph
- gpt_dynamic_inference_cuda_graphs_pad_tp4_pp1_ep4_16B_logitsmatch
- t5/t5_release_sm
- test_utils
- python_scripts
- recipes/h100
- unit_tests
- data
- fusions
- inference
- contexts
- attention_metadata
- engines
- text_generation_controllers
- models
- resharding
- rl
- ssm
- tensor_parallel
- transformer
- experimental_attention_variant
- tools
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
213 files changed
+122621
-81666
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
59 | 59 | | |
60 | 60 | | |
61 | 61 | | |
62 | | - | |
| 62 | + | |
63 | 63 | | |
64 | 64 | | |
65 | 65 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | 2 | | |
7 | 3 | | |
8 | 4 | | |
| |||
12 | 8 | | |
13 | 9 | | |
14 | 10 | | |
15 | | - | |
| 11 | + | |
16 | 12 | | |
17 | 13 | | |
18 | 14 | | |
19 | | - | |
| 15 | + | |
20 | 16 | | |
21 | 17 | | |
22 | 18 | | |
| |||
46 | 42 | | |
47 | 43 | | |
48 | 44 | | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
49 | 49 | | |
50 | 50 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
46 | | - | |
| 46 | + | |
47 | 47 | | |
48 | 48 | | |
49 | 49 | | |
| |||
136 | 136 | | |
137 | 137 | | |
138 | 138 | | |
139 | | - | |
| 139 | + | |
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| |||
159 | 159 | | |
160 | 160 | | |
161 | 161 | | |
162 | | - | |
| 162 | + | |
163 | 163 | | |
164 | 164 | | |
165 | 165 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
110 | 110 | | |
111 | 111 | | |
112 | 112 | | |
113 | | - | |
| 113 | + | |
114 | 114 | | |
115 | 115 | | |
116 | 116 | | |
| |||
221 | 221 | | |
222 | 222 | | |
223 | 223 | | |
224 | | - | |
| 224 | + | |
225 | 225 | | |
226 | 226 | | |
227 | 227 | | |
| |||
364 | 364 | | |
365 | 365 | | |
366 | 366 | | |
367 | | - | |
| 367 | + | |
368 | 368 | | |
369 | 369 | | |
370 | 370 | | |
| |||
495 | 495 | | |
496 | 496 | | |
497 | 497 | | |
498 | | - | |
| 498 | + | |
499 | 499 | | |
500 | 500 | | |
501 | 501 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
36 | | - | |
| 36 | + | |
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
| |||
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
63 | | - | |
| 63 | + | |
64 | 64 | | |
65 | 65 | | |
66 | 66 | | |
| |||
77 | 77 | | |
78 | 78 | | |
79 | 79 | | |
80 | | - | |
| 80 | + | |
81 | 81 | | |
82 | 82 | | |
83 | 83 | | |
| |||
90 | 90 | | |
91 | 91 | | |
92 | 92 | | |
93 | | - | |
| 93 | + | |
94 | 94 | | |
95 | 95 | | |
96 | 96 | | |
| |||
103 | 103 | | |
104 | 104 | | |
105 | 105 | | |
106 | | - | |
| 106 | + | |
107 | 107 | | |
108 | 108 | | |
109 | 109 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
17 | | - | |
| 17 | + | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | | - | |
7 | 5 | | |
8 | 6 | | |
9 | 7 | | |
10 | 8 | | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
11 | 12 | | |
12 | 13 | | |
13 | 14 | | |
14 | 15 | | |
| 16 | + | |
15 | 17 | | |
16 | 18 | | |
17 | 19 | | |
18 | 20 | | |
19 | 21 | | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
25 | 28 | | |
| 29 | + | |
26 | 30 | | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
27 | 55 | | |
| 56 | + | |
28 | 57 | | |
29 | 58 | | |
30 | 59 | | |
31 | | - | |
| 60 | + | |
| 61 | + | |
32 | 62 | | |
33 | 63 | | |
34 | 64 | | |
35 | 65 | | |
| 66 | + | |
36 | 67 | | |
37 | 68 | | |
38 | 69 | | |
39 | 70 | | |
| 71 | + | |
40 | 72 | | |
41 | 73 | | |
42 | | - | |
| 74 | + | |
43 | 75 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
| 14 | + | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
58 | 58 | | |
59 | 59 | | |
60 | 60 | | |
61 | | - | |
| 61 | + | |
62 | 62 | | |
63 | 63 | | |
64 | 64 | | |
| |||
0 commit comments