You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
README: Add criteria for featuregate test result windows and flake handling
Extended the feature gate test requirements section with:
- Definition of the time window for evaluating test results (7 or 14 days depending on run count).
- Clarification that test flakes count as failures and affect pass rates.
Copy file name to clipboardExpand all lines: README.md
+2Lines changed: 2 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -99,6 +99,8 @@ and then enforces the following rules.
99
99
3. Every test must be run on every TechPreview platform we have jobs for. (Ask for an exception if your feature doesn't support a variant.)
100
100
4. Every test must run at least 14 times on every platform/variant.
101
101
5. Every test must pass at least 95% of the time on every platform/variant.
102
+
6. Test results are taken from the last 7 days if the test was run at least 14 times during that period. Otherwise, data from the last 14 days is used.
103
+
7. Test flakes (even if the test eventually passes on a retry) are considered failures and negatively impact the pass rate.
102
104
103
105
If your FeatureGate lacks automated testing, there is an exception process that allows QE to sign off on the promotion by
0 commit comments