feat: Support Fused MoE non gated Relu2 NVFP4 & FP8 and support Nemotron, fixed#2462

Merged

yzh119 merged 31 commits intoflashinfer-ai:mainfrom

amitz-nv:fused-moe-non-gated-fp8

Feb 4, 2026

Commits on Feb 1, 2026

Using ActivationType instead of GatedActType, added compiled kernels, adjusted test
amitz-nv
committed
Add actType and eltwiseActType to 'no kernel found' message, move is_gated_activation function in tests to tests/moe/utils.py
amitz-nv
committed
Update remaining GatedActType uses to ActivationType, remove GatedActType enum from core.py, update docstrings
amitz-nv
committed
Use ActivationType in benchmarks, add missing activation_type argument
amitz-nv
committed
Minor fixes
amitz-nv
committed
Fix activation_type default value to Swiglu on trtllm_fp4_block_scale_moe
amitz-nv
committed
Minor improvement
amitz-nv
committed
Support non-gated activation in NVFP4 block scale MoE
amitz-nv
committed
Rename useShuffledMatrixA to useShuffledMatrix (remove the 'A' suffix)
amitz-nv
committed
Add FP4_NVFP4_NVFP4 parameterization to test_llama4_routing, update tests skip_checks to skip on non-gated activation with quantizations that don't support it
amitz-nv
committed

Commits on Feb 2, 2026

Commits on Feb 3, 2026