Skip to content

Commit dd11e25

Browse files
committed
Add Devstral 2 (Ministral3) model support
Add Ministral3ForCausalLM architecture mapping and ministral3 tokenizer type for Mistral AI's Devstral 2 models (Devstral-Small-2-24B, Devstral-2-123B). These models use the same Mistral3 architecture, so they reuse the existing Bumblebee.Text.Mistral3 implementation.
1 parent 297a8c0 commit dd11e25

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

lib/bumblebee.ex

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -174,6 +174,7 @@ defmodule Bumblebee do
174174
"Mistral3ForCausalLM" => {Bumblebee.Text.Mistral3, :for_causal_language_modeling},
175175
"Mistral3ForSequenceClassification" =>
176176
{Bumblebee.Text.Mistral3, :for_sequence_classification},
177+
"Ministral3ForCausalLM" => {Bumblebee.Text.Mistral3, :for_causal_language_modeling},
177178
"Mistral3ForConditionalGeneration" =>
178179
{Bumblebee.Multimodal.Mistral3, :for_conditional_generation},
179180
"PhiModel" => {Bumblebee.Text.Phi, :base},
@@ -263,6 +264,7 @@ defmodule Bumblebee do
263264
"llama" => :llama,
264265
"mistral" => :llama,
265266
"mistral3" => :llama,
267+
"ministral3" => :llama,
266268
"mbart" => :mbart,
267269
"phi" => :code_gen,
268270
"phi3" => :llama,

0 commit comments

Comments
 (0)