Commit f905170
committed
eager: warn once when int4_tensorwise runs the slow reference path on CUDA
A missing compiled extension silently drops int4_tensorwise to the eager
reference (~4x slower than the int8 kernels), which reads as 'int4 is
slow' rather than 'the kernels are not installed' (reported on a 4070 in
PR #63: 4.27 s/it eager vs the expected ~1 s/it). Warn once with the
actual reason: extension missing vs fused-path constraints unmet.1 parent 3e94fd4 commit f905170
1 file changed
Lines changed: 27 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1292 | 1292 | | |
1293 | 1293 | | |
1294 | 1294 | | |
| 1295 | + | |
| 1296 | + | |
| 1297 | + | |
1295 | 1298 | | |
1296 | 1299 | | |
1297 | 1300 | | |
| |||
1322 | 1325 | | |
1323 | 1326 | | |
1324 | 1327 | | |
| 1328 | + | |
| 1329 | + | |
| 1330 | + | |
| 1331 | + | |
| 1332 | + | |
| 1333 | + | |
| 1334 | + | |
| 1335 | + | |
| 1336 | + | |
| 1337 | + | |
| 1338 | + | |
| 1339 | + | |
| 1340 | + | |
| 1341 | + | |
| 1342 | + | |
| 1343 | + | |
| 1344 | + | |
| 1345 | + | |
| 1346 | + | |
| 1347 | + | |
| 1348 | + | |
| 1349 | + | |
| 1350 | + | |
| 1351 | + | |
1325 | 1352 | | |
1326 | 1353 | | |
1327 | 1354 | | |
| |||
0 commit comments