Skip to content

K8SPSMDB-1213 Add arm64 support for the e2e tests#2379

Open
jvpasinatto wants to merge 22 commits into
mainfrom
add-arm-support
Open

K8SPSMDB-1213 Add arm64 support for the e2e tests#2379
jvpasinatto wants to merge 22 commits into
mainfrom
add-arm-support

Conversation

@jvpasinatto

@jvpasinatto jvpasinatto commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

CHANGE DESCRIPTION

  • Replace e2e test images with multi-platform images that support ARM64.
  • Add missing docker.io prefixes to image references.
  • Update tests node tollerations settings to ensure ARM64 tests runs correctly
  • Add an ARCH environment variable to run tests on ARM64 nodes.
  • Enable multi-platform operator image builds in PR job
  • Automatically set the minimum supported GKE version in PR job

CHECKLIST

Jira

  • Is the Jira ticket created and referenced properly?
  • Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
  • Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

  • Is an E2E test/test case added for the new feature/change?
  • Are unit tests added where appropriate?
  • Are OpenShift compare files changed for E2E tests (compare/*-oc.yml)?

Config/Logging/Testability

  • Are all needed new/changed options added to default YAML files?
  • Are all needed new/changed options added to the Helm Chart?
  • Did we add proper logging messages for operator actions?
  • Did we ensure compatibility with the previous version or cluster upgrade process?
  • Does the change support oldest and newest supported MongoDB version?
  • Does the change support oldest and newest supported Kubernetes version?

Copilot AI review requested due to automatic review settings June 3, 2026 19:29
@pull-request-size pull-request-size Bot added the size/L 100-499 lines label Jun 3, 2026
@github-actions github-actions Bot added the tests label Jun 3, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR extends the e2e test harness to support running workloads on arm64 nodes (notably on GKE Arm), primarily by injecting kubernetes.io/arch nodeSelectors/tolerations into test manifests and adjusting several test images to be multi-arch friendly.

Changes:

  • Add ARCH-driven architecture scheduling support to e2e workloads (including some auto-detection for GKE Arm-only clusters).
  • Update multiple e2e manifests/scripts to use explicitly-qualified and/or multi-arch-capable container images.
  • Adjust e2e helper logic for helm installs and S3/MinIO checks (AWS CLI runner).

Reviewed changes

Copilot reviewed 19 out of 19 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
e2e-tests/README.md Document ARCH usage and update documented default image variables.
e2e-tests/functions Core implementation of arch scheduling (manifest transforms, kubectl wrapper, helm args), plus AWS CLI helper refactor.
e2e-tests/monitoring-pmm3/run Add arch-aware helm install parameters for PMM3 server chart.
e2e-tests/multi-cluster-service/run Ensure generated Pod manifest is arch-patched and use a pinned curl image.
e2e-tests/multi-cluster-service/conf/some-name.yml Pin busybox sidecar images to a specific tag.
e2e-tests/pitr-sharded/conf/some-name-rs0.yml Pin busybox sidecar images to a specific tag.
e2e-tests/pitr-sharded/conf/eks-some-name-rs0.yml Pin busybox sidecar images to a specific tag.
e2e-tests/pitr-physical/conf/some-name-rs0.yml Pin busybox sidecar images to a specific tag.
e2e-tests/expose-sharded/conf/some-name-rs0.yml Pin busybox sidecar images to a specific tag.
e2e-tests/demand-backup/run Switch MinIO bucket checks to the shared AWS CLI helper.
e2e-tests/demand-backup-sharded/run Switch MinIO bucket checks to the shared AWS CLI helper.
e2e-tests/demand-backup-sharded/conf/some-name-rs0.yml Pin busybox sidecar images to a specific tag.
e2e-tests/init-deploy/conf/another-name-rs0.yml Pin busybox sidecar images to a specific tag.
e2e-tests/ldap/conf/openldap.yaml Fully-qualify the OpenLDAP image reference.
e2e-tests/ldap-tls/conf/openldap.yaml Fully-qualify the OpenLDAP image reference.
e2e-tests/custom-users-roles-sharded/conf/some-name-rs0.yml Pin busybox sidecar images (but contains an invalid duplicated registry prefix).
e2e-tests/conf/cmctl.yml Use a pinned curl image and download the correct cmctl binary for the container’s architecture.
e2e-tests/conf/client.yml Use a multi-arch PSMDB client image tag.
e2e-tests/conf/client_with_tls.yml Use a multi-arch PSMDB client image tag (TLS variant).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread e2e-tests/custom-users-roles-sharded/conf/some-name-rs0.yml Outdated
Comment thread e2e-tests/functions Outdated
Comment thread e2e-tests/README.md Outdated
Comment thread e2e-tests/functions Outdated
Copilot AI review requested due to automatic review settings June 5, 2026 18:40

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 22 out of 22 changed files in this pull request and generated 6 comments.

Comment thread e2e-tests/functions
Comment thread e2e-tests/functions
Comment thread e2e-tests/README.md
Comment thread e2e-tests/version-service/conf/vs.yml
Comment thread e2e-tests/mongod-major-upgrade/conf/vs.yml
Comment thread e2e-tests/mongod-major-upgrade-sharded/conf/vs.yml
@hors hors added this to the v1.23.0 milestone Jun 8, 2026
Copilot AI review requested due to automatic review settings June 8, 2026 23:40
@pull-request-size pull-request-size Bot added size/XL 500-999 lines and removed size/L 100-499 lines labels Jun 8, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 33 out of 33 changed files in this pull request and generated 4 comments.

Comment thread e2e-tests/functions Outdated
Comment thread e2e-tests/functions Outdated
Comment thread e2e-tests/functions
local args=("$@")
local transformed_files=()

if arch_scheduling_enabled && [[ ${args[0]} == "run" ]]; then
Comment thread e2e-tests/functions
fi
fi

if arch_scheduling_enabled && [[ ${args[0]} == "apply" ]]; then
Copilot AI review requested due to automatic review settings June 9, 2026 10:44

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 33 out of 33 changed files in this pull request and generated 3 comments.

Comment thread e2e-tests/upgrade-sharded/run
Comment thread e2e-tests/version-service/run
Comment thread e2e-tests/README.md
Copilot AI review requested due to automatic review settings June 9, 2026 16:09

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 46 out of 46 changed files in this pull request and generated 5 comments.

Comment thread e2e-tests/functions
Comment thread e2e-tests/functions
Comment thread e2e-tests/version-service/conf/vs.yml
Comment thread e2e-tests/mongod-major-upgrade/conf/vs.yml
Comment thread e2e-tests/mongod-major-upgrade-sharded/conf/vs.yml
@jvpasinatto jvpasinatto requested a review from DhruthiKV June 12, 2026 16:29
Comment thread e2e-tests/conf/cmctl.yml Outdated
Comment thread e2e-tests/service-per-pod/run Outdated
Comment thread e2e-tests/functions
Comment thread e2e-tests/functions
retry=0
echo -n $backup
until kubectl_bin get cronjob/$backup -o jsonpath='{.status.lastScheduleTime}' 2>/dev/null | grep 'T'; do
if [[ ${patched} -eq 0 ]] && arch_scheduling_enabled && kubectl_bin get cronjob/$backup >/dev/null 2>&1; then

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This if seems odd to me, shouldn't it finish with ]]?

Copilot AI review requested due to automatic review settings June 15, 2026 16:47

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 47 out of 47 changed files in this pull request and generated 2 comments.

Comment thread e2e-tests/functions
Comment on lines +1824 to +1827
local args=("$@")
local transformed_files=()

if arch_scheduling_enabled && [[ ${args[0]} == "run" ]]; then
Comment thread e2e-tests/functions
fi
fi

if arch_scheduling_enabled && [[ ${args[0]} == "apply" ]]; then
@hors hors requested a review from valmiranogueira June 15, 2026 21:15
Comment thread e2e-tests/functions Outdated
Comment thread e2e-tests/functions Outdated
Copilot AI review requested due to automatic review settings June 18, 2026 14:46

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 47 out of 47 changed files in this pull request and generated 1 comment.

Comment thread e2e-tests/functions Outdated
@hors hors requested review from eleo007 and valmiranogueira June 18, 2026 17:36
Copilot AI review requested due to automatic review settings June 18, 2026 18:27

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 47 out of 47 changed files in this pull request and generated 2 comments.

Comment thread e2e-tests/functions
local args=("$@")
local transformed_files=()

if arch_scheduling_enabled && [[ ${args[0]} == "run" ]]; then
Comment thread e2e-tests/functions
fi
fi

if arch_scheduling_enabled && [[ ${args[0]} == "apply" ]]; then
@JNKPercona

Copy link
Copy Markdown
Collaborator
Test Name Result Time
arbiter passed 00:00:00
balancer passed 00:00:00
cert-management-policy passed 00:00:00
clustersync passed 00:00:00
cross-site-sharded passed 00:00:00
custom-replset-name passed 00:00:00
custom-tls passed 00:00:00
custom-users-roles passed 00:00:00
custom-users-roles-sharded passed 00:00:00
data-at-rest-encryption passed 00:00:00
data-sharded passed 00:00:00
demand-backup passed 00:00:00
demand-backup-eks-credentials-irsa passed 00:00:00
demand-backup-fs passed 00:00:00
demand-backup-if-unhealthy passed 00:00:00
demand-backup-incremental-aws passed 00:00:00
demand-backup-incremental-azure passed 00:00:00
demand-backup-incremental-gcp-native passed 00:00:00
demand-backup-incremental-gcp-s3 passed 00:00:00
demand-backup-incremental-minio passed 00:00:00
demand-backup-incremental-sharded-aws passed 00:00:00
demand-backup-incremental-sharded-azure passed 00:00:00
demand-backup-incremental-sharded-gcp-native passed 00:00:00
demand-backup-incremental-sharded-gcp-s3 passed 00:00:00
demand-backup-incremental-sharded-minio passed 00:00:00
demand-backup-logical-minio-native-tls passed 00:00:00
demand-backup-physical-parallel passed 00:00:00
demand-backup-physical-aws passed 00:00:00
demand-backup-physical-azure passed 00:00:00
demand-backup-physical-gcp-s3 passed 00:00:00
demand-backup-physical-gcp-native passed 00:00:00
demand-backup-physical-minio passed 00:00:00
demand-backup-physical-minio-native passed 00:00:00
demand-backup-physical-minio-native-tls passed 00:00:00
demand-backup-physical-sharded-parallel passed 00:00:00
demand-backup-physical-sharded-aws passed 00:00:00
demand-backup-physical-sharded-azure passed 00:00:00
demand-backup-physical-sharded-gcp-native passed 00:00:00
demand-backup-physical-sharded-minio passed 00:00:00
demand-backup-physical-sharded-minio-native passed 00:00:00
demand-backup-sharded passed 00:00:00
demand-backup-snapshot passed 00:00:00
demand-backup-snapshot-vault passed 00:00:00
disabled-auth passed 00:00:00
expose-sharded passed 00:00:00
finalizer passed 00:00:00
ignore-labels-annotations passed 00:00:00
init-deploy passed 00:00:00
ldap passed 00:00:00
ldap-tls passed 00:00:00
limits passed 00:00:00
liveness passed 00:00:00
mongod-major-upgrade passed 00:00:00
mongod-major-upgrade-sharded passed 00:00:00
monitoring-2-0 failure 00:15:39
monitoring-pmm3 passed 00:00:00
multi-cluster-service passed 00:00:00
multi-storage passed 00:00:00
non-voting-and-hidden passed 00:00:00
one-pod passed 00:00:00
operator-self-healing-chaos passed 00:00:00
pitr passed 00:00:00
pitr-physical passed 00:00:00
pitr-sharded passed 00:00:00
pitr-to-new-cluster passed 00:00:00
pitr-physical-backup-source passed 00:00:00
preinit-updates passed 00:00:00
pvc-auto-resize passed 00:00:00
pvc-resize passed 00:00:00
recover-no-primary passed 00:00:00
replset-overrides passed 00:00:00
replset-remapping passed 00:00:00
replset-remapping-sharded passed 00:00:00
rs-shard-migration passed 00:00:00
scaling passed 00:00:00
scheduled-backup passed 00:00:00
security-context passed 00:00:00
self-healing-chaos passed 00:00:00
service-per-pod passed 00:00:00
serviceless-external-nodes passed 00:00:00
smart-update passed 00:00:00
split-horizon passed 00:00:00
split-horizon-manual-tls passed 00:00:00
stable-resource-version passed 00:00:00
storage passed 00:00:00
tls-issue-cert-manager passed 00:00:00
unsafe-psa passed 00:00:00
upgrade failure 00:06:40
upgrade-consistency passed 00:00:00
upgrade-consistency-sharded-tls passed 00:00:00
upgrade-sharded failure 00:09:02
upgrade-partial-backup passed 00:00:00
users passed 00:00:00
users-vault passed 00:00:00
vector-search passed 00:00:00
vector-search-sharded passed 00:00:00
version-service passed 00:00:00
Summary Value
Tests Run 97/97
Job Duration 01:01:32
Total Test Time 00:31:22

commit: 78d57cb
image: perconalab/percona-server-mongodb-operator:PR-2379-78d57cb02

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/XL 500-999 lines tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants