Skip to content

[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention #9934

[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention

[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention #9934

Annotations

3 warnings

Test Linux CUDA x64 Release

succeeded Feb 14, 2026 in 41m 19s