Commit 418b42c
fix(attention): avoid FA3 with batch invariance on Hopper
Downgrade FlashAttention 3 to FlashAttention 2 on SM90 when batch invariance is enabled.
Fixes #47069
Co-authored-by: Devin AI <noreply@devin.ai>
Signed-off-by: Sidharth Rajmohan <dumko.raj@gmail.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>1 parent 1ff9429 commit 418b42c
1 file changed
Lines changed: 11 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
171 | 171 | | |
172 | 172 | | |
173 | 173 | | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
174 | 185 | | |
175 | 186 | | |
176 | 187 | | |
| |||
0 commit comments