Fix a bug in flash attention where kv_seq_len should divide block_k_m… #10997
Job | Run time |
---|---|
3s | |
34m 20s | |
1h 12m 30s | |
9m 48s | |
1m 48s | |
18m 22s | |
6m 30s | |
11m 9s | |
13m 34s | |
5m 55s | |
5m 5s | |
2h 59m 4s |
Job | Run time |
---|---|
3s | |
34m 20s | |
1h 12m 30s | |
9m 48s | |
1m 48s | |
18m 22s | |
6m 30s | |
11m 9s | |
13m 34s | |
5m 55s | |
5m 5s | |
2h 59m 4s |