Commit 7828bb8
committed
perf(ab_test): ignore noisy network and MMDS metrics on flaky instances
Add m5n.metal (al2 host), m8g.metal-{24,48}xl, and m8i.metal-{48,96}xl
to the IGNORED list for network latency and MMDS A/B tests respectively.
These instance/metric combinations exhibit high variance (up to 67%
swings in both directions) on unrelated commits, causing persistent
false-positive pipeline failures. The noise on m8g correlates with the
May 2 AL2023 rootfs update and affects only guest kernel linux-6.1
dimensions. MMDS noise on m8i is bidirectional within the same build.
The tests still run and collect data on these instances; they just no
longer block the pipeline.
Signed-off-by: Riccardo Mancini <mancio@amazon.com>1 parent 81236d8 commit 7828bb8
1 file changed
Lines changed: 12 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
135 | 135 | | |
136 | 136 | | |
137 | 137 | | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
138 | 150 | | |
139 | 151 | | |
140 | 152 | | |
| |||
0 commit comments