Commit c24f8a8
fix: skip llm_int8_linear on V100, fix sparse_attention columns shape
- test_ai_quantized_linear: Add _is_ampere_or_above() check to skip
TestLlmInt8Linear tests on GPUs with compute capability < 8.0
(CI V100 has sm_70, cublasLtMatmul returns CUBLAS_STATUS_NOT_SUPPORTED)
- test_ai_sparse_attention: Fix columns tensor shape from total_nnz
(B*H*S*nnz_per_row) to per_head_nnz (S*nnz_per_row), resolving
cusparse dimension mismatch (nnz > matrix_size) and segfault
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1 parent f05eb90 commit c24f8a8
File tree
2 files changed
+26
-10
lines changed- test/ai_edited_test
2 files changed
+26
-10
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
349 | 349 | | |
350 | 350 | | |
351 | 351 | | |
| 352 | + | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
352 | 364 | | |
353 | 365 | | |
354 | 366 | | |
| |||
357 | 369 | | |
358 | 370 | | |
359 | 371 | | |
360 | | - | |
| 372 | + | |
| 373 | + | |
361 | 374 | | |
362 | 375 | | |
363 | 376 | | |
| |||
373 | 386 | | |
374 | 387 | | |
375 | 388 | | |
376 | | - | |
| 389 | + | |
| 390 | + | |
377 | 391 | | |
378 | 392 | | |
379 | 393 | | |
| |||
391 | 405 | | |
392 | 406 | | |
393 | 407 | | |
394 | | - | |
| 408 | + | |
| 409 | + | |
395 | 410 | | |
396 | 411 | | |
397 | 412 | | |
| |||
406 | 421 | | |
407 | 422 | | |
408 | 423 | | |
409 | | - | |
| 424 | + | |
| 425 | + | |
410 | 426 | | |
411 | 427 | | |
412 | 428 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
82 | 82 | | |
83 | 83 | | |
84 | 84 | | |
85 | | - | |
| 85 | + | |
86 | 86 | | |
87 | 87 | | |
88 | 88 | | |
| |||
91 | 91 | | |
92 | 92 | | |
93 | 93 | | |
94 | | - | |
| 94 | + | |
95 | 95 | | |
96 | 96 | | |
97 | 97 | | |
| |||
263 | 263 | | |
264 | 264 | | |
265 | 265 | | |
| 266 | + | |
266 | 267 | | |
267 | 268 | | |
268 | 269 | | |
269 | | - | |
270 | | - | |
| 270 | + | |
271 | 271 | | |
272 | 272 | | |
273 | 273 | | |
| |||
323 | 323 | | |
324 | 324 | | |
325 | 325 | | |
| 326 | + | |
326 | 327 | | |
327 | 328 | | |
328 | 329 | | |
329 | | - | |
330 | | - | |
| 330 | + | |
331 | 331 | | |
332 | 332 | | |
333 | 333 | | |
| |||
0 commit comments