Actions: vllm-project/vllm
Actions
2,500+ workflow runs
2,500+ workflow runs
--enable-sleep-mode OOMs loading an NVFP4 (modelopt) 30B on 16GB SM120 cards where the identical model loads fine without it — cumem MemPool overhead, not resolved by raising max_split_size_mb
Label issues based on keywords
#14254:
Issue #48680
opened
by
JasonVranek
minimax_m3 reasoning parser splits structured-output JSON at a <mm:think> the model wrote as content
Label issues based on keywords
#14251:
Issue #48663
opened
by
onesource2026