Skip to content

#526: Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow#527

Merged
tkilias merged 21 commits into
mainfrom
refactoring/move_ami_ci_from_codebuild_to_github
Jun 3, 2026
Merged

#526: Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow#527
tkilias merged 21 commits into
mainfrom
refactoring/move_ami_ci_from_codebuild_to_github

Conversation

@tkilias

@tkilias tkilias commented May 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • move the release workflow into the package and remove the legacy release script tree
  • migrate the AWS-backed CI from CodeBuild to GitHub Actions
  • rename the AWS CI test tree from test/codebuild to test/aws_ci
  • clarify the CI docs so the integration job and Docker-image build path are described separately

Validation

  • poetry run -- pytest -q test/unit/test_release_build.py test/unit/test_release_notes.py test/unit/test_release_workflow.py test/unit/test_build_cli.py
  • poetry run -- pytest -q test/unit/test_ci_workflow.py

Issues

Closes #525
Closes #526

tkilias added 2 commits May 29, 2026 09:05
Move the release workflow and note generation into the package CLI layer, update GitHub Actions to use the new entrypoint, and remove the legacy scripts/build, githooks, and vagrant trees.

Also update the release docs/tests and remove shellcheck now that the shell-script trees are gone.

Closes #525
- Rename the AWS-backed CI tests from test/codebuild to test/aws_ci
- Clarify the CI docs to separate integration tests from AWS-backed CI
- Keep the GitHub Actions workflow aligned with the new test path and approval gate
- Remove the deprecated CodeBuild release/CI infrastructure
@tkilias tkilias requested a deployment to approve-test-execution May 29, 2026 08:28 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution May 29, 2026 08:28 — with GitHub Actions Waiting
Comment thread exasol/ds/sandbox/lib/release_workflow.py Outdated
Comment thread test/unit/test_ci_workflow.py Outdated
Use a shared GitPython-based repo root helper for release changelog lookups so check_release.py and release_notes.py do not depend on their file depth. Add a regression test for the helper and keep the changelog lookup coverage.
@tkilias tkilias requested a deployment to approve-test-execution May 29, 2026 09:14 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution May 29, 2026 09:14 — with GitHub Actions Waiting
Set the CI version-check step to workflow_dispatch release mode so release-workflow check validates the changelog and version without treating the pull-request merge ref as a release tag. Update the workflow regression test accordingly.
@tkilias tkilias requested a deployment to approve-gpu-test-execution May 29, 2026 09:23 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-test-execution May 29, 2026 09:23 — with GitHub Actions Waiting
@tkilias tkilias temporarily deployed to approve-aws-ci-execution May 29, 2026 09:24 — with GitHub Actions Inactive
Align the AWS-backed CI job with the release workflow by using release_user for the AWS user name. Update the workflow regression test to match.
@tkilias tkilias requested a deployment to approve-test-execution May 29, 2026 09:58 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution May 29, 2026 09:58 — with GitHub Actions Waiting
@tkilias tkilias temporarily deployed to approve-aws-ci-execution May 29, 2026 09:59 — with GitHub Actions Inactive
- Inject AwsAccess from the release-workflow CLI before starting the release build
- Remove the brittle workflow-string test for the CI YAML
- Keep the release workflow tests aligned with the new run_build signature
@tkilias tkilias requested a deployment to approve-gpu-test-execution May 29, 2026 10:11 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-test-execution May 29, 2026 10:11 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-aws-ci-execution May 29, 2026 10:12 — with GitHub Actions Waiting
Comment thread .github/workflows/ci.yaml Outdated
Switch the AWS-backed CI workflow to the github-ai-lab-ci-role role with ci-user as the resource owner label. Update the AWS guide wording so CI and release are described as separate OIDC roles with shared baseline permissions.
@tkilias tkilias requested a deployment to approve-gpu-test-execution May 29, 2026 13:14 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-test-execution May 29, 2026 13:14 — with GitHub Actions Waiting
@tkilias tkilias temporarily deployed to approve-aws-ci-execution May 29, 2026 13:15 — with GitHub Actions Inactive
@tkilias tkilias had a problem deploying to approve-gpu-test-execution May 29, 2026 13:42 — with GitHub Actions Error
@tkilias tkilias had a problem deploying to approve-test-execution May 29, 2026 13:42 — with GitHub Actions Error
@tkilias tkilias temporarily deployed to approve-aws-ci-execution May 29, 2026 13:43 — with GitHub Actions Inactive
@tkilias tkilias changed the title [codex] Refactor CI workflow and AWS test layout #413: Fix Luigi signal handling in notebook DockerDB startup and SLC build Jun 2, 2026
@tkilias tkilias changed the title #413: Fix Luigi signal handling in notebook DockerDB startup and SLC build Refactor CI workflow and AWS test layout Jun 2, 2026
@tkilias tkilias changed the title Refactor CI workflow and AWS test layout Move CI workflow to Github and refactor CD workflow Jun 2, 2026
@tkilias tkilias changed the title Move CI workflow to Github and refactor CD workflow Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow Jun 2, 2026
@tkilias tkilias changed the title Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow #528: Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow Jun 2, 2026
@tkilias tkilias changed the title #528: Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow #526: Migrate AWS-backed CI workflow to GitHub Actions and refactor release workflow Jun 2, 2026
@tkilias tkilias requested a deployment to approve-test-execution June 2, 2026 09:34 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution June 2, 2026 09:34 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-aws-ci-execution June 2, 2026 09:34 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution June 2, 2026 09:35 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-test-execution June 2, 2026 09:35 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-aws-ci-execution June 2, 2026 09:36 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-test-execution June 2, 2026 12:59 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution June 2, 2026 12:59 — with GitHub Actions Waiting
@tkilias tkilias deployed to AWS_RELEASE June 2, 2026 13:00 — with GitHub Actions Active
@tkilias tkilias requested a deployment to approve-aws-ci-execution June 2, 2026 13:00 — with GitHub Actions Waiting
@tkilias tkilias marked this pull request as ready for review June 2, 2026 18:55
@tkilias tkilias requested a deployment to approve-test-execution June 2, 2026 18:57 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution June 2, 2026 18:57 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-aws-ci-execution June 2, 2026 18:58 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-test-execution June 2, 2026 19:04 — with GitHub Actions Waiting
@tkilias tkilias requested a deployment to approve-gpu-test-execution June 2, 2026 19:04 — with GitHub Actions Waiting
Comment thread .github/workflows/ci.yaml
Comment on lines +26 to +29
env:
RELEASE_MODE: workflow_dispatch
RELEASE_TITLE: CI validation
run: poetry run -- ai-lab release check

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once we introduce the PTB here, we don't need this anymore.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Migrate AWS-backed CI from CodeBuild to GitHub Actions Clean up release workflow follow-up and remove legacy repo trees

2 participants