Commit 726fdaf
[NPUW] gemma-2 patterns added to preserve tail constants matcher (#32465)
### Details:
- gemma2-sym works fine after weight preserved as constants. Performance
matches expectations
<img width="370" height="640" alt="image"
src="https://github.com/user-attachments/assets/8b2c7f39-9c32-4db8-af0f-cbe6429366fd"
/>
- gemma2-asym works but accuracy issues found. Performance matches
expectations too
<img width="402" height="721" alt="image"
src="https://github.com/user-attachments/assets/464d02b2-fd7a-4d85-a1fb-72f77a944e12"
/>
- as of compiler version 7.28 no accuracy issues observed anymore - this
patch behavior by default restricted to this compiler version only.
### Tickets:
- E-189635
---------
Co-authored-by: Dmitry Matveev <dmitry.matveev@intel.com>1 parent 7e5c0d9 commit 726fdaf
File tree
13 files changed
+137
-43
lines changed- src/plugins/intel_npu
- src
- al
- include/intel_npu
- config
- src/config
- plugin
- include
- npuw
- partitioning
- patterns
- src
- tests/functional/internal/plugin
13 files changed
+137
-43
lines changedLines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
57 | 57 | | |
58 | 58 | | |
59 | 59 | | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
60 | 67 | | |
61 | 68 | | |
62 | 69 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
112 | 112 | | |
113 | 113 | | |
114 | 114 | | |
| 115 | + | |
115 | 116 | | |
116 | 117 | | |
117 | 118 | | |
| |||
Lines changed: 9 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
216 | 216 | | |
217 | 217 | | |
218 | 218 | | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
219 | 228 | | |
220 | 229 | | |
221 | 230 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
| 32 | + | |
32 | 33 | | |
33 | 34 | | |
34 | 35 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
172 | 172 | | |
173 | 173 | | |
174 | 174 | | |
| 175 | + | |
175 | 176 | | |
176 | 177 | | |
177 | 178 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
635 | 635 | | |
636 | 636 | | |
637 | 637 | | |
638 | | - | |
639 | | - | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
640 | 642 | | |
641 | 643 | | |
642 | 644 | | |
| |||
2506 | 2508 | | |
2507 | 2509 | | |
2508 | 2510 | | |
| 2511 | + | |
2509 | 2512 | | |
2510 | 2513 | | |
2511 | 2514 | | |
| |||
Lines changed: 65 additions & 29 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
46 | 63 | | |
47 | 64 | | |
48 | 65 | | |
| |||
54 | 71 | | |
55 | 72 | | |
56 | 73 | | |
57 | | - | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
58 | 78 | | |
59 | 79 | | |
60 | 80 | | |
| |||
63 | 83 | | |
64 | 84 | | |
65 | 85 | | |
66 | | - | |
67 | | - | |
68 | | - | |
69 | | - | |
70 | | - | |
71 | | - | |
72 | | - | |
73 | | - | |
74 | | - | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
75 | 107 | | |
76 | 108 | | |
77 | 109 | | |
| |||
323 | 355 | | |
324 | 356 | | |
325 | 357 | | |
326 | | - | |
327 | | - | |
328 | | - | |
329 | | - | |
330 | | - | |
331 | | - | |
332 | | - | |
333 | | - | |
334 | | - | |
335 | | - | |
336 | | - | |
337 | | - | |
338 | | - | |
339 | | - | |
340 | | - | |
341 | | - | |
342 | 358 | | |
343 | 359 | | |
344 | 360 | | |
| |||
348 | 364 | | |
349 | 365 | | |
350 | 366 | | |
351 | | - | |
| 367 | + | |
352 | 368 | | |
353 | 369 | | |
354 | 370 | | |
355 | 371 | | |
356 | 372 | | |
357 | | - | |
| 373 | + | |
358 | 374 | | |
359 | 375 | | |
360 | 376 | | |
| |||
1175 | 1191 | | |
1176 | 1192 | | |
1177 | 1193 | | |
| 1194 | + | |
1178 | 1195 | | |
1179 | 1196 | | |
1180 | 1197 | | |
| |||
1212 | 1229 | | |
1213 | 1230 | | |
1214 | 1231 | | |
| 1232 | + | |
| 1233 | + | |
| 1234 | + | |
| 1235 | + | |
| 1236 | + | |
| 1237 | + | |
| 1238 | + | |
| 1239 | + | |
| 1240 | + | |
| 1241 | + | |
| 1242 | + | |
| 1243 | + | |
| 1244 | + | |
1215 | 1245 | | |
1216 | 1246 | | |
1217 | 1247 | | |
| |||
1260 | 1290 | | |
1261 | 1291 | | |
1262 | 1292 | | |
| 1293 | + | |
| 1294 | + | |
| 1295 | + | |
| 1296 | + | |
| 1297 | + | |
| 1298 | + | |
| 1299 | + | |
1263 | 1300 | | |
1264 | 1301 | | |
1265 | 1302 | | |
| |||
1896 | 1933 | | |
1897 | 1934 | | |
1898 | 1935 | | |
1899 | | - | |
1900 | 1936 | | |
1901 | 1937 | | |
1902 | 1938 | | |
| |||
Lines changed: 5 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1494 | 1494 | | |
1495 | 1495 | | |
1496 | 1496 | | |
| 1497 | + | |
| 1498 | + | |
| 1499 | + | |
1497 | 1500 | | |
1498 | | - | |
1499 | | - | |
| 1501 | + | |
| 1502 | + | |
1500 | 1503 | | |
1501 | 1504 | | |
1502 | 1505 | | |
| |||
Lines changed: 35 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1919 | 1919 | | |
1920 | 1920 | | |
1921 | 1921 | | |
1922 | | - | |
| 1922 | + | |
| 1923 | + | |
1923 | 1924 | | |
1924 | 1925 | | |
1925 | 1926 | | |
| |||
1930 | 1931 | | |
1931 | 1932 | | |
1932 | 1933 | | |
1933 | | - | |
| 1934 | + | |
| 1935 | + | |
| 1936 | + | |
| 1937 | + | |
| 1938 | + | |
| 1939 | + | |
| 1940 | + | |
| 1941 | + | |
| 1942 | + | |
| 1943 | + | |
| 1944 | + | |
| 1945 | + | |
| 1946 | + | |
| 1947 | + | |
| 1948 | + | |
1934 | 1949 | | |
1935 | 1950 | | |
1936 | 1951 | | |
| |||
1964 | 1979 | | |
1965 | 1980 | | |
1966 | 1981 | | |
1967 | | - | |
| 1982 | + | |
1968 | 1983 | | |
1969 | 1984 | | |
1970 | 1985 | | |
1971 | 1986 | | |
| 1987 | + | |
1972 | 1988 | | |
1973 | | - | |
1974 | | - | |
| 1989 | + | |
| 1990 | + | |
| 1991 | + | |
| 1992 | + | |
| 1993 | + | |
| 1994 | + | |
| 1995 | + | |
| 1996 | + | |
| 1997 | + | |
| 1998 | + | |
| 1999 | + | |
| 2000 | + | |
| 2001 | + | |
| 2002 | + | |
| 2003 | + | |
1975 | 2004 | | |
1976 | 2005 | | |
1977 | 2006 | | |
| |||
1997 | 2026 | | |
1998 | 2027 | | |
1999 | 2028 | | |
2000 | | - | |
| 2029 | + | |
2001 | 2030 | | |
2002 | 2031 | | |
2003 | 2032 | | |
| |||
Lines changed: 5 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
| 26 | + | |
26 | 27 | | |
27 | 28 | | |
28 | 29 | | |
| |||
229 | 230 | | |
230 | 231 | | |
231 | 232 | | |
232 | | - | |
| 233 | + | |
233 | 234 | | |
234 | 235 | | |
235 | | - | |
| 236 | + | |
236 | 237 | | |
237 | | - | |
| 238 | + | |
238 | 239 | | |
239 | 240 | | |
240 | 241 | | |
241 | 242 | | |
242 | | - | |
| 243 | + | |
243 | 244 | | |
244 | 245 | | |
245 | 246 | | |
| |||
0 commit comments