Run end-to-end tests over different K8s + Linux combinations

[dottorblaster]

Now that our end to end testing suite can run against arbitrary clusters, we need to continuously evaluate our project across different combinations of Kubernetes and Linux kernel versions/configurations.

Test matrix

Please refer to Kubernetes versions and Linux versions (also distributions) present at this page

Examples

• AKS/EKS/GKE (from 1.28 to 1.31)
• SLES 15 SP5/6 + RKE2 (from 1.28 to 1.31)
• Oracle Linux (8.8 to 9.5) + RKE2 (from 1.28 to 1.31)
• RHEL (8.8 to 9.5) + k3s (from 1.28 to 1.31)

Acceptance Criteria

• Tests are ran not on pull requests but on a timely fashion, potentially weekly basis
• Tests are ran on releases
• Tests (as in the workflow) are manually runnable
• Ignore RKE1

[holyspectral]

EKS 1.28 has been EOL and 1.29's extended support will end in a few weeks. https://docs.aws.amazon.com/eks/latest/userguide/kubernetes-versions.html

[holyspectral]

Per our discussion, we will start from in-house RKE2 first.