Skip to content

Commit 7152b1b

Browse files
Merge pull request #2302 from alebedev87/featuregate-testresult-aging
README: Add criteria for featuregate test result windows and flake handling
2 parents d22fca8 + 446c4bf commit 7152b1b

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -99,6 +99,8 @@ and then enforces the following rules.
9999
3. Every test must be run on every TechPreview platform we have jobs for. (Ask for an exception if your feature doesn't support a variant.)
100100
4. Every test must run at least 14 times on every platform/variant.
101101
5. Every test must pass at least 95% of the time on every platform/variant.
102+
6. Test results are taken from the last 7 days if the test was run at least 14 times during that period. Otherwise, data from the last 14 days is used.
103+
7. Test flakes (even if the test eventually passes on a retry) are considered failures and negatively impact the pass rate.
102104

103105
If your FeatureGate lacks automated testing, there is an exception process that allows QE to sign off on the promotion by
104106
commenting on the PR.

0 commit comments

Comments
 (0)