Skip to content

Commit 4292a08

Browse files
committed
[auto][on-merge-queue] Update metrics report in README.md
1 parent c51a1c4 commit 4292a08

File tree

207 files changed

+14246
-14454
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

207 files changed

+14246
-14454
lines changed

README.md

Lines changed: 153 additions & 153 deletions
Large diffs are not rendered by default.

docs/OperationsReport.md

Lines changed: 125 additions & 127 deletions
Large diffs are not rendered by default.

docs/models/Autoencoder (conv)-train/input_variations.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -12,9 +12,9 @@
1212
### aten.convolution.default
1313
| | ATen Input Variations | Status | Isolated | PCC | Host |
1414
|---:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
15-
| 0 | Tensor<[1, 1, 28, 28]> input = ?,<br>Tensor<[16, 1, 3, 3]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999982 | 6 |
16-
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999993 | 6 |
17-
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999983 | 6 |
15+
| 0 | Tensor<[1, 1, 28, 28]> input = ?,<br>Tensor<[16, 1, 3, 3]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999983 | 6 |
16+
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
17+
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.99998 | 6 |
1818
| 3 | Tensor<[1, 4, 7, 7]> input = ?,<br>Tensor<[4, 16, 2, 2]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999995 | 6 |
1919
### aten.convolution_backward.default
2020
| | ATen Input Variations | Status | Isolated | PCC | Host |

docs/models/Autoencoder (conv)/input_variations.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,8 +9,8 @@
99
| | ATen Input Variations | Status | Isolated | PCC | Host |
1010
|---:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
1111
| 0 | Tensor<[1, 1, 28, 28]> input = ?,<br>Tensor<[16, 1, 3, 3]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999983 | 6 |
12-
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999993 | 6 |
13-
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999979 | 6 |
12+
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
13+
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.99998 | 6 |
1414
| 3 | Tensor<[1, 4, 7, 7]> input = ?,<br>Tensor<[4, 16, 2, 2]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
1515
### aten.max_pool2d_with_indices.default
1616
| | ATen Input Variations | Status | Isolated | PCC | Host |

docs/models/Autoencoder (linear)-train/input_variations.md

Lines changed: 21 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -14,13 +14,13 @@
1414
| | ATen Input Variations | Status | Isolated | PCC | Host |
1515
|---:|:-------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
1616
| 0 | Tensor<[128]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999988 | 0 |
17-
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999886 | 0 |
18-
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999994 | 0 |
19-
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999974 | 0 |
20-
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999999 | 0 |
21-
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999975 | 0 |
17+
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999968 | 0 |
18+
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999999 | 0 |
19+
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999991 | 0 |
20+
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999946 | 0 |
21+
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.99998 | 0 |
2222
| 6 | Tensor<[64]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999991 | 0 |
23-
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.99998 | 0 |
23+
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999976 | 0 |
2424
### aten.detach.default
2525
| | ATen Input Variations | Status | Isolated | PCC | Host |
2626
|---:|:--------------------------|:---------|:-----------|------:|-------:|
@@ -30,22 +30,22 @@
3030
### aten.mm.default
3131
| | ATen Input Variations | Status | Isolated | PCC | Host |
3232
|---:|:----------------------------------------------------------|:---------|:-----------|---------:|-------:|
33-
| 0 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.99996 | 0 |
34-
| 1 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999978 | 0 |
35-
| 2 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 1 | 0 |
33+
| 0 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999978 | 0 |
34+
| 1 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999982 | 0 |
35+
| 2 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999996 | 0 |
3636
| 3 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999994 | 0 |
37-
| 4 | Tensor<[1, 3]> self = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999997 | 0 |
38-
| 5 | Tensor<[1, 64]> self = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999991 | 0 |
39-
| 6 | Tensor<[1, 64]> self = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999993 | 0 |
40-
| 7 | Tensor<[1, 784]> self = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999891 | 0 |
41-
| 8 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 3]> mat2 = ? | Done | Done | 1 | 0 |
42-
| 9 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999996 | 0 |
43-
| 10 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999996 | 0 |
44-
| 11 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 784]> mat2 = ? | Done | Done | 0.999996 | 0 |
45-
| 12 | Tensor<[3, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999996 | 0 |
46-
| 13 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999996 | 0 |
47-
| 14 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999997 | 0 |
48-
| 15 | Tensor<[784, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999996 | 0 |
37+
| 4 | Tensor<[1, 3]> self = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999988 | 0 |
38+
| 5 | Tensor<[1, 64]> self = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999992 | 0 |
39+
| 6 | Tensor<[1, 64]> self = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999994 | 0 |
40+
| 7 | Tensor<[1, 784]> self = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999963 | 0 |
41+
| 8 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 3]> mat2 = ? | Done | Done | 0.999996 | 0 |
42+
| 9 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999991 | 0 |
43+
| 10 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999992 | 0 |
44+
| 11 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 784]> mat2 = ? | Done | Done | 0.999993 | 0 |
45+
| 12 | Tensor<[3, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999992 | 0 |
46+
| 13 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999993 | 0 |
47+
| 14 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999992 | 0 |
48+
| 15 | Tensor<[784, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999992 | 0 |
4949
### aten.relu.default
5050
| | ATen Input Variations | Status | Isolated | PCC | Host |
5151
|---:|:--------------------------|:---------|:-----------|------:|-------:|

docs/models/Autoencoder (linear)/input_variations.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -8,14 +8,14 @@
88
### aten.addmm.default
99
| | ATen Input Variations | Status | Isolated | PCC | Host |
1010
|---:|:-------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
11-
| 0 | Tensor<[128]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999988 | 0 |
12-
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999893 | 0 |
13-
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999993 | 0 |
14-
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999996 | 0 |
15-
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999997 | 0 |
16-
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999985 | 0 |
17-
| 6 | Tensor<[64]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999994 | 0 |
18-
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.99998 | 0 |
11+
| 0 | Tensor<[128]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999984 | 0 |
12+
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999969 | 0 |
13+
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999992 | 0 |
14+
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999983 | 0 |
15+
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999979 | 0 |
16+
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999975 | 0 |
17+
| 6 | Tensor<[64]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.99999 | 0 |
18+
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999974 | 0 |
1919
### aten.relu.default
2020
| | ATen Input Variations | Status | Isolated | PCC | Host |
2121
|---:|:--------------------------|:---------|:-----------|------:|-------:|

docs/models/BERT/input_variations.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@
2626
### aten._softmax.default
2727
| | ATen Input Variations | Status | Isolated | PCC | Host |
2828
|---:|:-----------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
29-
| 0 | Tensor<[1, 16, 256, 256]> self = ?,<br>int dim = -1,<br>bool half_to_float = False | Done | Done | 0.999599 | 0 |
29+
| 0 | Tensor<[1, 16, 256, 256]> self = ?,<br>int dim = -1,<br>bool half_to_float = False | Done | Done | 0.999594 | 0 |
3030
### aten._to_copy.default
3131
| | ATen Input Variations | Status | Isolated | PCC | Host |
3232
|---:|:-------------------------------------------------------------------------|:---------|:-----------|------:|-------:|
@@ -39,15 +39,15 @@
3939
### aten.addmm.default
4040
| | ATen Input Variations | Status | Isolated | PCC | Host |
4141
|---:|:-------------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
42-
| 0 | Tensor<[1024]> self = ?,<br>Tensor<[256, 1024]> mat1 = ?,<br>Tensor<[1024, 1024]> mat2 = ? | Done | Done | 0.999964 | 0 |
42+
| 0 | Tensor<[1024]> self = ?,<br>Tensor<[256, 1024]> mat1 = ?,<br>Tensor<[1024, 1024]> mat2 = ? | Done | Done | 0.999965 | 0 |
4343
| 1 | Tensor<[1024]> self = ?,<br>Tensor<[256, 4096]> mat1 = ?,<br>Tensor<[4096, 1024]> mat2 = ? | Done | Done | 0.999932 | 0 |
44-
| 2 | Tensor<[2]> self = ?,<br>Tensor<[256, 1024]> mat1 = ?,<br>Tensor<[1024, 2]> mat2 = ? | Done | Done | 0.999864 | 0 |
44+
| 2 | Tensor<[2]> self = ?,<br>Tensor<[256, 1024]> mat1 = ?,<br>Tensor<[1024, 2]> mat2 = ? | Done | Done | 0.999964 | 0 |
4545
| 3 | Tensor<[4096]> self = ?,<br>Tensor<[256, 1024]> mat1 = ?,<br>Tensor<[1024, 4096]> mat2 = ? | Done | Done | 0.999964 | 0 |
4646
### aten.bmm.default
4747
| | ATen Input Variations | Status | Isolated | PCC | Host |
4848
|---:|:-------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
49-
| 0 | Tensor<[16, 256, 256]> self = ?,<br>Tensor<[16, 256, 64]> mat2 = ? | Done | Done | 0.999965 | 0 |
50-
| 1 | Tensor<[16, 256, 64]> self = ?,<br>Tensor<[16, 64, 256]> mat2 = ? | Done | Done | 0.999988 | 0 |
49+
| 0 | Tensor<[16, 256, 256]> self = ?,<br>Tensor<[16, 256, 64]> mat2 = ? | Done | Done | 0.999979 | 0 |
50+
| 1 | Tensor<[16, 256, 64]> self = ?,<br>Tensor<[16, 64, 256]> mat2 = ? | Done | Done | 0.999986 | 0 |
5151
### aten.clone.default
5252
| | ATen Input Variations | Status | Isolated | PCC | Host |
5353
|---:|:--------------------------------------------------------------------------------------------|:---------|:-----------|------:|-------:|
@@ -78,7 +78,7 @@
7878
### aten.mul.Tensor
7979
| | ATen Input Variations | Status | Isolated | PCC | Host |
8080
|---:|:---------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
81-
| 0 | Tensor<[1, 1, 1, 256]> self = ?,<br>Tensor other = -3.3895313892515355e+38 | Done | Done | 0.999995 | 0 |
81+
| 0 | Tensor<[1, 1, 1, 256]> self = ?,<br>Tensor other = -3.3895313892515355e+38 | Done | Done | 0.999996 | 0 |
8282
### aten.native_layer_norm.default
8383
| | ATen Input Variations | Status | Isolated | PCC | Host |
8484
|---:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------|:-----------|:------|-------:|

0 commit comments

Comments
 (0)