feat(azure): Add Azure Container Instance module for DataHub Remote Executor#41
Open
acrylJonny wants to merge 2 commits intomainfrom
Open
feat(azure): Add Azure Container Instance module for DataHub Remote Executor#41acrylJonny wants to merge 2 commits intomainfrom
acrylJonny wants to merge 2 commits intomainfrom
Conversation
…xecutor This module enables deployment of the DataHub Remote Ingestion Executor to Azure Container Instances (ACI), providing feature parity with existing ECS and Helm deployments. Key Features: - Full DataHub executor configuration (pool ID, workers, polling intervals) - Multiple secret management options (environment variables, secret volumes, Key Vault) - Azure networking support (public, private, or none IP addressing) - Managed identity integration - Azure Files volume mounting - Health probes (readiness and liveness) - Log Analytics integration - Comprehensive documentation with examples Tested and validated: - Successfully deployed to Azure Container Instance - Connected to test-environment.acryl.io - Verified executor pool registration and task processing - Uses Docker registry (docker.datahub.com/re/datahub-executor) Module structure follows ECS module conventions with simplified documentation approach.
Terraform modules should not commit lock files as they are meant to be resolved by the consumer of the module.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds a new Terraform module for deploying the DataHub Remote Ingestion Executor to Azure Container Instances (ACI), providing full feature parity with the existing ECS and Helm chart deployments.
Features
docker.datahub.com/re/datahub-executor)