Skip to content

Commit 0ece750

Browse files
vmilosevicchandrasekaranpradeep
vmilosevic
and
chandrasekaranpradeep
authored
Update model analysis documentation (#1303)
This PR will update model analysis documentation. Co-authored-by: chandrasekaranpradeep <[email protected]>
1 parent c9ff10d commit 0ece750

File tree

276 files changed

+85640
-6350
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

276 files changed

+85640
-6350
lines changed

‎model_analysis_docs/ModelsInfo.md‎

Lines changed: 861 additions & 451 deletions
Large diffs are not rendered by default.

‎model_analysis_docs/models/albert/pt_albert_base_v1_mlm_hf.md‎

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -104,9 +104,9 @@
104104
<td>dtype : torch.float32</td>
105105
<td>&#x2705;</td>
106106
<td>&#x2705;</td>
107-
<td>&#x2705;</td>
108-
<td></td>
107+
<td>&#x274C;</td>
109108
<td></td>
109+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
110110
</tr>
111111
<tr>
112112
<th>9</th>
@@ -115,9 +115,9 @@
115115
<td></td>
116116
<td>&#x2705;</td>
117117
<td>&#x2705;</td>
118-
<td>&#x2705;</td>
119-
<td></td>
118+
<td>&#x274C;</td>
120119
<td></td>
120+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
121121
</tr>
122122
<tr>
123123
<th>10</th>
@@ -137,9 +137,9 @@
137137
<td></td>
138138
<td>&#x2705;</td>
139139
<td>&#x2705;</td>
140-
<td>&#x2705;</td>
141-
<td></td>
140+
<td>&#x274C;</td>
142141
<td></td>
142+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
143143
</tr>
144144
<tr>
145145
<th>12</th>
@@ -366,11 +366,11 @@
366366
<td>RepeatInterleave</td>
367367
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
368368
<td>repeats : 1<br>dim : 0</td>
369-
<td>&#x2705;</td>
370-
<td>&#x2705;</td>
371-
<td>&#x2705;</td>
372-
<td></td>
369+
<td>&#x274C;</td>
370+
<td>&#x274C;</td>
371+
<td>&#x274C;</td>
373372
<td></td>
373+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
374374
</tr>
375375
<tr>
376376
<th>33</th>
@@ -630,22 +630,22 @@
630630
<td>Unsqueeze</td>
631631
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
632632
<td>dim : 1</td>
633-
<td>&#x2705;</td>
634-
<td>&#x2705;</td>
635-
<td>&#x2705;</td>
636-
<td></td>
633+
<td>&#x274C;</td>
634+
<td>&#x274C;</td>
635+
<td>&#x274C;</td>
637636
<td></td>
637+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
638638
</tr>
639639
<tr>
640640
<th>57</th>
641641
<td>Unsqueeze</td>
642642
<td>Operand(type=Activation, shape=(1, 1, 128), dtype=int64)</td>
643643
<td>dim : 2</td>
644-
<td>&#x2705;</td>
645-
<td>&#x2705;</td>
646-
<td>&#x2705;</td>
647-
<td></td>
644+
<td>&#x274C;</td>
645+
<td>&#x274C;</td>
646+
<td>&#x274C;</td>
648647
<td></td>
648+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
649649
</tr>
650650
</tbody>
651651
</table>

‎model_analysis_docs/models/albert/pt_albert_base_v1_token_cls_hf.md‎

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -93,9 +93,9 @@
9393
<td>dtype : torch.float32</td>
9494
<td>&#x2705;</td>
9595
<td>&#x2705;</td>
96-
<td>&#x2705;</td>
97-
<td></td>
96+
<td>&#x274C;</td>
9897
<td></td>
98+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
9999
</tr>
100100
<tr>
101101
<th>8</th>
@@ -104,9 +104,9 @@
104104
<td></td>
105105
<td>&#x2705;</td>
106106
<td>&#x2705;</td>
107-
<td>&#x2705;</td>
108-
<td></td>
107+
<td>&#x274C;</td>
109108
<td></td>
109+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
110110
</tr>
111111
<tr>
112112
<th>9</th>
@@ -126,9 +126,9 @@
126126
<td></td>
127127
<td>&#x2705;</td>
128128
<td>&#x2705;</td>
129-
<td>&#x2705;</td>
130-
<td></td>
129+
<td>&#x274C;</td>
131130
<td></td>
131+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
132132
</tr>
133133
<tr>
134134
<th>11</th>
@@ -333,11 +333,11 @@
333333
<td>RepeatInterleave</td>
334334
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
335335
<td>repeats : 1<br>dim : 0</td>
336-
<td>&#x2705;</td>
337-
<td>&#x2705;</td>
338-
<td>&#x2705;</td>
339-
<td></td>
336+
<td>&#x274C;</td>
337+
<td>&#x274C;</td>
338+
<td>&#x274C;</td>
340339
<td></td>
340+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
341341
</tr>
342342
<tr>
343343
<th>30</th>
@@ -586,22 +586,22 @@
586586
<td>Unsqueeze</td>
587587
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
588588
<td>dim : 1</td>
589-
<td>&#x2705;</td>
590-
<td>&#x2705;</td>
591-
<td>&#x2705;</td>
592-
<td></td>
589+
<td>&#x274C;</td>
590+
<td>&#x274C;</td>
591+
<td>&#x274C;</td>
593592
<td></td>
593+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
594594
</tr>
595595
<tr>
596596
<th>53</th>
597597
<td>Unsqueeze</td>
598598
<td>Operand(type=Activation, shape=(1, 1, 128), dtype=int64)</td>
599599
<td>dim : 2</td>
600-
<td>&#x2705;</td>
601-
<td>&#x2705;</td>
602-
<td>&#x2705;</td>
603-
<td></td>
600+
<td>&#x274C;</td>
601+
<td>&#x274C;</td>
602+
<td>&#x274C;</td>
604603
<td></td>
604+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
605605
</tr>
606606
</tbody>
607607
</table>

‎model_analysis_docs/models/albert/pt_albert_base_v2_mlm_hf.md‎

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -104,9 +104,9 @@
104104
<td>dtype : torch.float32</td>
105105
<td>&#x2705;</td>
106106
<td>&#x2705;</td>
107-
<td>&#x2705;</td>
108-
<td></td>
107+
<td>&#x274C;</td>
109108
<td></td>
109+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
110110
</tr>
111111
<tr>
112112
<th>9</th>
@@ -115,9 +115,9 @@
115115
<td></td>
116116
<td>&#x2705;</td>
117117
<td>&#x2705;</td>
118-
<td>&#x2705;</td>
119-
<td></td>
118+
<td>&#x274C;</td>
120119
<td></td>
120+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
121121
</tr>
122122
<tr>
123123
<th>10</th>
@@ -137,9 +137,9 @@
137137
<td></td>
138138
<td>&#x2705;</td>
139139
<td>&#x2705;</td>
140-
<td>&#x2705;</td>
141-
<td></td>
140+
<td>&#x274C;</td>
142141
<td></td>
142+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
143143
</tr>
144144
<tr>
145145
<th>12</th>
@@ -366,11 +366,11 @@
366366
<td>RepeatInterleave</td>
367367
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
368368
<td>repeats : 1<br>dim : 0</td>
369-
<td>&#x2705;</td>
370-
<td>&#x2705;</td>
371-
<td>&#x2705;</td>
372-
<td></td>
369+
<td>&#x274C;</td>
370+
<td>&#x274C;</td>
371+
<td>&#x274C;</td>
373372
<td></td>
373+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
374374
</tr>
375375
<tr>
376376
<th>33</th>
@@ -630,22 +630,22 @@
630630
<td>Unsqueeze</td>
631631
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
632632
<td>dim : 1</td>
633-
<td>&#x2705;</td>
634-
<td>&#x2705;</td>
635-
<td>&#x2705;</td>
636-
<td></td>
633+
<td>&#x274C;</td>
634+
<td>&#x274C;</td>
635+
<td>&#x274C;</td>
637636
<td></td>
637+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
638638
</tr>
639639
<tr>
640640
<th>57</th>
641641
<td>Unsqueeze</td>
642642
<td>Operand(type=Activation, shape=(1, 1, 128), dtype=int64)</td>
643643
<td>dim : 2</td>
644-
<td>&#x2705;</td>
645-
<td>&#x2705;</td>
646-
<td>&#x2705;</td>
647-
<td></td>
644+
<td>&#x274C;</td>
645+
<td>&#x274C;</td>
646+
<td>&#x274C;</td>
648647
<td></td>
648+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
649649
</tr>
650650
</tbody>
651651
</table>

‎model_analysis_docs/models/albert/pt_albert_base_v2_token_cls_hf.md‎

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -93,9 +93,9 @@
9393
<td>dtype : torch.float32</td>
9494
<td>&#x2705;</td>
9595
<td>&#x2705;</td>
96-
<td>&#x2705;</td>
97-
<td></td>
96+
<td>&#x274C;</td>
9897
<td></td>
98+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
9999
</tr>
100100
<tr>
101101
<th>8</th>
@@ -104,9 +104,9 @@
104104
<td></td>
105105
<td>&#x2705;</td>
106106
<td>&#x2705;</td>
107-
<td>&#x2705;</td>
108-
<td></td>
107+
<td>&#x274C;</td>
109108
<td></td>
109+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
110110
</tr>
111111
<tr>
112112
<th>9</th>
@@ -126,9 +126,9 @@
126126
<td></td>
127127
<td>&#x2705;</td>
128128
<td>&#x2705;</td>
129-
<td>&#x2705;</td>
130-
<td></td>
129+
<td>&#x274C;</td>
131130
<td></td>
131+
<td>[TT_METAL][TT-Metal vs Forge Output Data mismatch] ValueError Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model , compiled_model</td>
132132
</tr>
133133
<tr>
134134
<th>11</th>
@@ -333,11 +333,11 @@
333333
<td>RepeatInterleave</td>
334334
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
335335
<td>repeats : 1<br>dim : 0</td>
336-
<td>&#x2705;</td>
337-
<td>&#x2705;</td>
338-
<td>&#x2705;</td>
339-
<td></td>
336+
<td>&#x274C;</td>
337+
<td>&#x274C;</td>
338+
<td>&#x274C;</td>
340339
<td></td>
340+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
341341
</tr>
342342
<tr>
343343
<th>30</th>
@@ -586,22 +586,22 @@
586586
<td>Unsqueeze</td>
587587
<td>Operand(type=Activation, shape=(1, 128), dtype=int64)</td>
588588
<td>dim : 1</td>
589-
<td>&#x2705;</td>
590-
<td>&#x2705;</td>
591-
<td>&#x2705;</td>
592-
<td></td>
589+
<td>&#x274C;</td>
590+
<td>&#x274C;</td>
591+
<td>&#x274C;</td>
593592
<td></td>
593+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
594594
</tr>
595595
<tr>
596596
<th>53</th>
597597
<td>Unsqueeze</td>
598598
<td>Operand(type=Activation, shape=(1, 1, 128), dtype=int64)</td>
599599
<td>dim : 2</td>
600-
<td>&#x2705;</td>
601-
<td>&#x2705;</td>
602-
<td>&#x2705;</td>
603-
<td></td>
600+
<td>&#x274C;</td>
601+
<td>&#x274C;</td>
602+
<td>&#x274C;</td>
604603
<td></td>
604+
<td>[FORGE][TT-Metal vs Forge Output Dtype mismatch] E TypeError: Dtype mismatch: framework_model.dtype=torch.int64, compiled_model.dtype=torch.int32</td>
605605
</tr>
606606
</tbody>
607607
</table>

0 commit comments

Comments
 (0)