Add support for ModelOpt MXFP8 MoE models #35986

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

vllm-bot merged 6 commits into vllm-project:main from de-inf:mxfp8_flashinfer_moe

Mar 8, 2026

+597 −18

Merged

Add support for ModelOpt MXFP8 MoE models #35986

Add error for non-Swiglu MXFP8 MoE (not supported).

Meta CodeSync / Meta Internal-Only Changes Check succeeded Mar 8, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync