Skip to content

Commit 3f175f1

Browse files
authored
[Bugfix] Fix multimodal configuration for Qwen3VL MOE model (#30670)
Signed-off-by: Max Hu <[email protected]>
1 parent ed586e7 commit 3f175f1

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

vllm/model_executor/models/qwen3_vl_moe.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -418,6 +418,11 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
418418

419419
self.config = config
420420
self.multimodal_config = multimodal_config
421+
self.use_data_parallel = multimodal_config.mm_encoder_tp_mode == "data"
422+
self.video_pruning_rate = multimodal_config.video_pruning_rate
423+
self.is_multimodal_pruning_enabled = (
424+
multimodal_config.is_multimodal_pruning_enabled()
425+
)
421426

422427
if not multimodal_config.get_limit_per_prompt(
423428
"image"

0 commit comments

Comments
 (0)