Update the robustness tests process to maintain reproducability

[serathius]

/cc @nwnt @henrybear327

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 68.43%. Comparing base (a438759) to head (c428065).
⚠️ Report is 9 commits behind head on main.

Additional details and impacted files

see 21 files with indirect coverage changes

@@            Coverage Diff             @@
##             main   #21084      +/-   ##
==========================================
- Coverage   68.44%   68.43%   -0.02%     
==========================================
  Files         429      429              
  Lines       35281    35281              
==========================================
- Hits        24149    24143       -6     
- Misses       9732     9733       +1     
- Partials     1400     1405       +5     

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a438759...c428065. Read the comment docs.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[serathius]

Couldn't reproduce make test-robustness-issue19179 on 8866fce commit. Tested 20 minutes.

[serathius]

Reproduced make test-robustness-issue17529 on 5e42ed9 after 5 minutes. But no repro on latest main branch for 20 minutes.

[henrybear327]

Thanks Marek.

[nwnt]

LGTM

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: henrybear327, nwnt, serathius

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [serathius]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment