Is your feature request related to a problem? Please describe:
The current https://storage.googleapis.com/kubevirt-prow/reports/most-flaky-tests/kubevirt/kubevirt/index.html#index has a filtering issue that hides critical 3-day flakiness data if failure rate < 20%.
Current Behavior:
The script collects data for two time ranges but applies strict filtering:
- 3 days: Shows only if failure rate >= 20%
- 14 days: Shows only if failure rate >= 5%
Problem:
When a test has 15% failure in last 3 days (below 20%) but 6% failure in last 14 days (above 5%), the report only displays the 14-day data, completely hiding the more critical recent spike.
Why This Matters:
According to the https://github.com/kubevirt/kubevirt/blob/main/docs/quarantine.md, tests with >20% failure in 3 days need immediate attention. The current report need to enhance to:
- Quickly identify recently degraded tests
- Distinguish between long-term flaky tests vs recent breakage
- Prioritize quarantine candidates by urgency
Example:
Report shows: test xxxx - 6% over 14 days on lane X
Hidden data: test xxxx - 18% over 3 days on lane X ⚠️ Critical! But not auto-quarantine.
Describe the solution you'd like:
Tests case failures > 10% in 3 days are visually highlighted in the report for quickly identify the degraded tests.
Describe alternatives you've considered:
A clear and concise description of any alternative solutions or features you've considered.
Additional context:
Add any other context or screenshots about the feature request here.
Is your feature request related to a problem? Please describe:
The current https://storage.googleapis.com/kubevirt-prow/reports/most-flaky-tests/kubevirt/kubevirt/index.html#index has a filtering issue that hides critical 3-day flakiness data if failure rate < 20%.
Current Behavior:
The script collects data for two time ranges but applies strict filtering:
Problem:
When a test has 15% failure in last 3 days (below 20%) but 6% failure in last 14 days (above 5%), the report only displays the 14-day data, completely hiding the more critical recent spike.
Why This Matters:
According to the https://github.com/kubevirt/kubevirt/blob/main/docs/quarantine.md, tests with >20% failure in 3 days need immediate attention. The current report need to enhance to:
Example:⚠️ Critical! But not auto-quarantine.
Report shows: test xxxx - 6% over 14 days on lane X
Hidden data: test xxxx - 18% over 3 days on lane X
Describe the solution you'd like:
Tests case failures > 10% in 3 days are visually highlighted in the report for quickly identify the degraded tests.
Describe alternatives you've considered:
A clear and concise description of any alternative solutions or features you've considered.
Additional context:
Add any other context or screenshots about the feature request here.