@@ -136,45 +136,69 @@ Open-source models trained with LoongForge or its predecessor AIAK-Training-LLM:
136136<a id =" models " ></a >
137137## 🏛️ Supported Models
138138
139- LoongForge supports a broad range of [ state-of-the-art models] ( https://loongforge.readthedocs.io/en/latest/get_started/support_model.html ) across LLM, VLM, diffusion, and embodied.
140-
141- | ** Category** | ** Architectures** | ** Models** |
142- | ---------------| ------------------| ------------|
143- | ** LLM** | DeepSeek-V2 | deepseek-v2-lite, deepseek-v2 |
144- | | DeepSeek-V3 | deepseek-v3, deepseek-v32 |
145- | | DeepSeek-V4 | deepseek-v4-flash, deepseek-v4-pro |
146- | | LLaMA2 | llama2-7b, llama2-13b, llama2-70b |
147- | | LLaMA3 | llama3-8b, llama3-70b |
148- | | LLaMA3.1 | llama3.1-8b, llama3.1-70b, llama3.1-405b |
149- | | Qwen | qwen-1.8b → qwen-72b |
150- | | Qwen1.5 | qwen1.5-0.5b → qwen1.5-72b |
151- | | Qwen2 | qwen2-0.5b → qwen2-72b |
152- | | Qwen2.5 | qwen2.5-0.5b → qwen2.5-72b |
153- | | Qwen3 | qwen3-0.6b → qwen3-480b-a35b, qwen3-coder-30b-a3b |
154- | | Qwen3-Next | qwen3-next-80b-a3b |
155- | | MiniMax | minimax-m2.1, minimax-m2.5, minimax-m2.7 |
156- | | MIMO | mimo-7b |
157- | | GLM | glm5 |
158- | ** VLM** | Qwen2.5-VL | qwen2.5-vl-3b → qwen2.5-vl-72b |
159- | | Qwen3-VL | qwen3-vl-30b-a3b, qwen3-vl-235b-a22b |
160- | | Qwen3.5 | qwen3.5-0.8b → qwen3.5-397b-a17b |
161- | | Qwen3.6 | qwen3.6-27b, qwen3.6-35b-a3b |
162- | | Kimi-K2.5 | kimi-k2.5, kimi-k2.6 |
163- | | ERNIE4.5-VL | ernie4.5vl-28b-a3b |
164- | | LLaVA-OneVision-1.5 | llava-onevision-1.5-4b |
165- | | InternVL2.5 | internvl2.5-8b → internvl2.5-78b |
166- | | InternVL3.5 | internvl3.5-8b → internvl3.5-241b-a28b |
167- | | CustomCombinedModel | Flexible ViT + LLM backbone configuration ([ example] ( https://github.com/baidu-baige/LoongForge/blob/master/configs/models/custom/qwen_vit_llama3_8b.yaml ) ) |
168- | ** Diffusion** | Wan2.1 | wan2-1-i2v |
169- | | Wan2.2 | wan2-2-i2v |
170- | | Qwen-Image | qwen-image-edit-2511 |
171- | ** Embodied** | Pi | pi0.5 |
172- | | GR00T | groot_n1_6, groot_n1_7 |
173- | | XVLA | xvla |
174- | | FastWAM | fastwam |
175- | | LingBot-VA | lingbot_va |
176- | | Cosmos3 | cosmos3_nano |
177- | | DreamZero | dreamzero_lora_wan22_5b, dreamzero_full_wan22_5b, dreamzero_lora_wan21_14b, dreamzero_full_wan21_14b, dreamzero_libero_wan22_5b, dreamzero_agibot_wan21_14b, dreamzero_yam_wan21_14b |
139+ LoongForge supports a broad range of model families across LLM, VLM, diffusion, and embodied. Select a model below to open its training examples, or see the full [ model support matrix] ( https://loongforge.readthedocs.io/en/latest/get_started/support_model.html ) for supported variants.
140+
141+ <table style =" width : 100% ; table-layout : auto ; border-collapse : collapse ;" >
142+ <thead align =" center " valign =" bottom " >
143+ <tr ><th >LLM</th ><th >VLM</th ><th >Diffusion</th ><th >Embodied</th ></tr >
144+ </thead >
145+ <tbody valign =" top " >
146+ <tr >
147+ <td valign =" top " >
148+ <ul >
149+ <li ><a href =" examples/deepseek_v2/ " >DeepSeek-V2</a > ✅</li >
150+ <li ><a href =" examples/deepseek_v3/ " >DeepSeek-V3/V3.2</a > ✅</li >
151+ <li ><a href =" examples/deepseek_v4/ " >DeepSeek-V4</a > ✅</li >
152+ <li ><a href =" examples/llama2/ " >LLaMA2</a > ✅</li >
153+ <li ><a href =" examples/llama3/ " >LLaMA3</a > ✅</li >
154+ <li ><a href =" examples/llama3.1/ " >LLaMA3.1</a > ✅</li >
155+ <li ><a href =" examples/qwen/ " >Qwen</a > ✅</li >
156+ <li ><a href =" examples/qwen1.5/ " >Qwen1.5</a > ✅</li >
157+ <li ><a href =" examples/qwen2/ " >Qwen2</a > ✅</li >
158+ <li ><a href =" examples/qwen2.5/ " >Qwen2.5</a > ✅</li >
159+ <li ><a href =" examples/qwen3/ " >Qwen3</a > ✅</li >
160+ <li ><a href =" examples/qwen3_next/ " >Qwen3-Next</a > ✅</li >
161+ <li ><a href =" examples/minimax/ " >MiniMax-M2.1/2.5/2.7</a > ✅</li >
162+ <li ><a href =" examples/mimo/ " >MIMO</a > ✅</li >
163+ <li ><a href =" examples/glm5/ " >GLM-5</a > ✅</li >
164+ </ul >
165+ </td >
166+ <td valign =" top " >
167+ <ul >
168+ <li ><a href =" examples/qwen2.5_vl/ " >Qwen2.5-VL</a > ✅</li >
169+ <li ><a href =" examples/qwen3_vl/ " >Qwen3-VL</a > ✅</li >
170+ <li ><a href =" examples/qwen3.5/ " >Qwen3.5</a > ✅</li >
171+ <li ><a href =" examples/qwen3.6/ " >Qwen3.6</a > ✅</li >
172+ <li ><a href =" examples/kimi_k2.x/kimi_k2.5/ " >Kimi-K2.5/2.6</a > ✅</li >
173+ <li ><a href =" examples/ernie4.5/ " >ERNIE4.5-VL</a > ✅</li >
174+ <li ><a href =" examples/llava_onevision_1.5/ " >LLaVA-OneVision-1.5</a > ✅</li >
175+ <li ><a href =" examples/internvl2.5/ " >InternVL2.5</a > ✅</li >
176+ <li ><a href =" examples/internvl3.5/ " >InternVL3.5</a > ✅</li >
177+ <li ><a href =" examples/custom/ " >CustomCombinedModel Example</a > ✅</li >
178+ </ul >
179+ </td >
180+ <td valign =" top " >
181+ <ul >
182+ <li ><a href =" examples/wan/ " >Wan2.1</a > ✅</li >
183+ <li ><a href =" examples/wan/ " >Wan2.2</a > ✅</li >
184+ <li ><a href =" examples/qwen_image/ " >Qwen-Image</a > ✅</li >
185+ </ul >
186+ </td >
187+ <td valign =" top " >
188+ <ul >
189+ <li ><a href =" examples/embodied/pi05/ " >Pi0.5</a > ✅</li >
190+ <li ><a href =" examples/embodied/groot_n1_6/ " >GR00T-N1.6</a > ✅</li >
191+ <li ><a href =" examples/embodied/groot_n1_7/ " >GR00T-N1.7</a > ✅</li >
192+ <li ><a href =" examples/embodied/xvla/ " >xVLA</a > ✅</li >
193+ <li ><a href =" examples/embodied/fastwam/ " >FastWAM</a > ✅</li >
194+ <li ><a href =" examples/embodied/lingbot_va/ " >LingBot-VA</a > ✅</li >
195+ <li ><a href =" examples/embodied/cosmos3/ " >Cosmos3</a > ✅</li >
196+ <li ><a href =" examples/embodied/dreamzero/ " >DreamZero</a > ✅</li >
197+ </ul >
198+ </td >
199+ </tr >
200+ </tbody >
201+ </table >
178202
179203## 📂 Repository Layout
180204
0 commit comments