ATTN precision issue when LR is high #33
Description
Aiter has a precision issue. Compared with flash-attn, the output abs-max is larger than flash-attn.
Fp8 block-wise attn also have this issue. This can lead to unstable training when the learning rate is high.
@xiaobochen-amd @kyle-256