Add per test suite measurements and use them for SLIs

[oxddr]

Currently we do measure all SLIs per test, but actually there is no reason not to run them per test suite. Benefits of having SLIs measure per test suite:

• more data points - important especially in shorter tests, where we lack data points and they are prone to flakiness due to single spikes
• more concise test configuration - measurements needs to be configured once

/area slo
/area clusterloader

[k8s-ci-robot]

@oxddr: The label(s) area/ cannot be appled. These labels are supported: api-review, community/discussion, community/maintenance, community/question, cuj/build-train-deploy, cuj/multi-user, platform/aws, platform/azure, platform/gcp, platform/minikube, platform/other

Details

In response to this:

Currently we do measure all SLIs per test, but actually there is no reason not to run them per test suite. Benefits of having SLIs measure per test suite:

• more data points - important especially in shorter tests, where we lack data points and they are prone to flakiness due to single spikes
• more concise test configuration - measurements needs to be configured once

/area slo
/area clusterloader

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[fejta-bot]

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

[oxddr]

/remove-lifecycle stale

[fejta-bot]

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

[wojtek-t]

/remove-lifecycle stale
/lifecycle frozen