Skip to content

[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention #20665

[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention

[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention #20665

Annotations

2 warnings

Objective-C-StaticAnalysis

succeeded Feb 14, 2026 in 3m 1s