feat(aks): evolve from embedded to operators for ref arch

[marcel-dias]

feat(aks): evolve from embedded to operators for ref arch

see ticket details https://github.com/camunda/team-infrastructure-experience/issues/1029

This pull request introduces support for deploying Elasticsearch via the ECK (Elastic Cloud on Kubernetes) operator in the Azure AKS single-region test workflow. The changes remove legacy Elasticsearch configuration from Helm values files and update the workflow to use operator-based overlays and actions for deployment and cleanup. This streamlines Elasticsearch management and aligns it with operator-based practices.

Workflow integration for ECK Elasticsearch:

• Added .github/actions/kubernetes-eck-operator, .github/actions/kubernetes-eck-operator-cleanup, and generic/kubernetes/operator-based/elasticsearch to the workflow triggers, enabling proper detection and execution for ECK operator-related changes.
• Introduced steps in the workflow to deploy Elasticsearch using the ECK operator, including merging the operator overlay config and cleaning up the deployment after tests. [1] [2] [3]

Configuration changes:

• Removed legacy elasticsearch.enabled: true settings from values-domain.yml and values-no-domain.yml, clarifying that Elasticsearch is now managed via the ECK operator and configured through a dedicated overlay file. [1] [2] [3] [4]

Test environment enhancements:

• Added elasticsearch-service-name to test action inputs, ensuring tests can connect to the correct Elasticsearch service provisioned by the operator.

[github-actions]

🔀 Skip Workflow Checklist

Check the boxes below to skip specific workflows for this PR.

Global options

• skip_all - Skip all workflows

Individual workflows

• skip_aws_cognito_daily_cleanup
• skip_aws_common_procedure_s3_bucket
• skip_aws_compute_ec2_single_region_daily_cleanup
• skip_aws_compute_ec2_single_region_golden
• skip_aws_compute_ec2_single_region_tests
• skip_aws_ecs_single_region_fargate_daily_cleanup
• skip_aws_ecs_single_region_fargate_golden
• skip_aws_ecs_single_region_fargate_tests
• skip_aws_eks_single_region_daily_cleanup
• skip_aws_kubernetes_eks_dual_region_daily_cleanup
• skip_aws_kubernetes_eks_dual_region_golden
• skip_aws_kubernetes_eks_dual_region_teleport_tests
• skip_aws_kubernetes_eks_dual_region_tests
• skip_aws_kubernetes_eks_single_region_golden
• skip_aws_kubernetes_eks_single_region_tests
• skip_aws_modules_eks_rds_os_create_destruct_tests
• skip_aws_modules_eks_rds_os_daily_cleanup
• skip_aws_modules_eks_rds_os_tests
• skip_aws_openshift_rosa_hcp_dual_region_golden
• skip_aws_openshift_rosa_hcp_dual_region_tests
• skip_aws_openshift_rosa_hcp_single_region_golden
• skip_aws_openshift_rosa_hcp_single_region_tests
• skip_aws_rosa_hcp_dual_region_daily_cleanup
• skip_aws_rosa_hcp_single_region_daily_cleanup
• skip_azure_aks_single_region_daily_cleanup
• skip_azure_common_procedure_storageaccount_test
• skip_azure_kubernetes_aks_single_region_golden
• skip_azure_kubernetes_aks_single_region_tests
• skip_generic_kubernetes_operator_based_test
• skip_internal_global_pr_todo_checker
• skip_local_kubernetes_kind_single_region_tests

---

This checklist is automatically managed. Checked items will skip the corresponding workflow.

[Copilot]

Pull request overview

This pull request migrates the Azure AKS single-region test workflow from using embedded Elasticsearch (deployed via Helm chart) to operator-based Elasticsearch using the Elastic Cloud on Kubernetes (ECK) operator. This change aligns the AKS workflow with the existing ROSA workflow pattern and modernizes the infrastructure management approach.

Changes:

• Removed legacy elasticsearch.enabled: true configuration from Helm values files, as Elasticsearch is now managed by the ECK operator
• Added ECK operator deployment and cleanup steps to the workflow, including proper action triggers for automated testing
• Updated test configuration to pass the ECK-provisioned Elasticsearch service name (elasticsearch-es-http:9200) to the test action

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
.github/workflows/azure_kubernetes_aks_single_region_tests.yml	Added ECK operator workflow triggers, deployment step before Keycloak, cleanup step, and elasticsearch-service-name parameter to tests
azure/kubernetes/aks-single-region/helm-values/values-domain.yml	Removed embedded Elasticsearch configuration and added documentation about ECK operator overlay
azure/kubernetes/aks-single-region/helm-values/values-no-domain.yml	Removed embedded Elasticsearch configuration and added documentation about ECK operator overlay

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[leiicamundi]

One small comment, otherwise lgtm
Will do a second review with the doc to verify consistency

@marcel-dias please fix #1903 (comment) before merge