Skip to content

[Bugfix][Quantization] Reduce NVFP4 MoE load memory under sleep mode#48701

Draft
hubunt wants to merge 1 commit into
vllm-project:mainfrom
hubunt:fix/nvfp4-sleep-mode-load-oom
Draft

[Bugfix][Quantization] Reduce NVFP4 MoE load memory under sleep mode#48701
hubunt wants to merge 1 commit into
vllm-project:mainfrom
hubunt:fix/nvfp4-sleep-mode-load-oom

Commits

Commits on Jul 15, 2026