Skip to content

Releases: Dao-AILab/sonic-moe

Hopper and Blackwell GPUs

Choose a tag to compare

@GarlGuo GarlGuo released this 20 Apr 20:22

We transform the Grouped GEMM backend to QuACK Grouped GEMM. It supports Blackwell and Hopper GPUs simultaneously.

Hopper GPUs

Choose a tag to compare

@GarlGuo GarlGuo released this 25 Feb 19:31
022992f

Support NVidia Hopper GPUs and exactly implement all components on the arxiv paper: https://arxiv.org/pdf/2512.14080

A preliminary version of Blackwell GPUs are runnable with by setting USE_QUACK_GEMM=1 environment variable. For example, USE_QUACK_GEMM=1 python benchmarks/moe-cute.py. But the Blackwell versions are under optimized at this moment, which we will improve on the next release.