Hi @tridao @GarlGuo , I have carefully read through the whole codebase. Amazing work! I am wondering if I can use SonicMoE kernels for FP8? Thank you!