Skip to content

ci: build deploy-camunda binary on the nightly integration path#6439

Merged
eamonnmoloney merged 2 commits into
mainfrom
fix/nightly-deploy-camunda-binary-artifact-name
Jun 24, 2026
Merged

ci: build deploy-camunda binary on the nightly integration path#6439
eamonnmoloney merged 2 commits into
mainfrom
fix/nightly-deploy-camunda-binary-artifact-name

Conversation

@eamonnmoloney

Copy link
Copy Markdown
Contributor

Which problem does the PR fix?

Every SM nightly that enters the Helm integration suite through
test-integration-template.yaml (e.g. SM Nightly 8.10 Upgrade Minor)
fails immediately at the Download deploy-camunda binary step:

Unable to download artifact(s): Artifact not found for name: deploy-camunda-binary

All downstream steps (Helm install, Playwright e2e, upgrade) are then
skipped. This is a CI plumbing gap, not a chart or test regression.

Example failing run:
https://github.com/camunda/c8-cross-component-e2e-tests/actions/runs/28075385080/job/83118495302

What's in this PR?

test-integration-runner.yaml downloads a pre-built deploy-camunda-binary
artifact in its install / upgrade / cleanup jobs. That artifact is
only produced on the PR / merge-queue entrypoint — test-chart-version.yaml's
init job, via the generate-chart-matrix composite action. The nightly
path enters test-integration-template.yaml directly (from the E2E repo's
reusable flow), whose init job never builds or uploads the binary, so the
download has no producer.

This PR:

  • Builds + uploads the binary in test-integration-template.yaml's init
    job
    (cache-restore → conditional Go build → upload), so both entry paths
    have a producer. The cache key matches the existing one, so the PR path
    restores from cache rather than rebuilding.
  • Suffixes the artifact name with the per-leg identifier
    (deploy-camunda-binary-${{ inputs.identifier }}). The upgrade-minor
    nightlies invoke the reusable flow twice in a single run (8.9 install +
    8.10 upgrade); a static artifact name would collide under
    upload-artifact@v4+ immutability. identifier is already required to be
    unique per deployment (it keys the namespace/hostname), so it is a safe
    uniqueness key.
  • Adds a binary-artifact-name input to test-integration-runner.yaml
    (default deploy-camunda-binary) used by the three download steps. The
    template passes the suffixed name; the PR-CI path keeps the default and is
    unchanged.

Checklist

Before opening the PR:

  • In the repo's root dir, run make go.update-golden-only.
  • There is no other open pull request for the same update/change.
  • Tests for charts are added (if needed).
  • In-repo documentation are updated (if needed).

After opening the PR:

  • Did you sign our CLA (Contributor License Agreement)? It will show once you open the PR.
  • Did all checks/tests pass in the PR?

The integration runner downloads a pre-built `deploy-camunda-binary`
artifact in its install/upgrade/cleanup jobs, but that artifact was only
produced on the PR/merge-queue entrypoint (`test-chart-version.yaml`'s
init job, via the generate-chart-matrix action). Nightlies enter through
`test-integration-template.yaml` directly and never built/uploaded it, so
every nightly failed early at "Download deploy-camunda binary" with
"Artifact not found for name: deploy-camunda-binary" — before any deploy
or test ran.

Build and upload the binary in the template's init job so both entry
paths have a producer. Because the upgrade-minor nightlies invoke the
reusable flow twice in a single run (e.g. 8.9 install + 8.10 upgrade),
the artifact name is suffixed with the per-leg `identifier` (already
guaranteed unique per deployment) to avoid same-run artifact-name
collisions; the runner downloads via a new `binary-artifact-name` input
that defaults to the original static name, leaving the PR-CI path
unchanged.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@eamonnmoloney eamonnmoloney marked this pull request as ready for review June 24, 2026 05:01
@eamonnmoloney eamonnmoloney requested a review from a team as a code owner June 24, 2026 05:01
@eamonnmoloney eamonnmoloney requested review from bkenez and Copilot and removed request for a team June 24, 2026 05:01

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR fixes a CI artifact-production gap by ensuring the deploy-camunda binary artifact is available when the integration suite enters via test-integration-template.yaml (nightly/E2E entry path), and by making the runner workflow’s artifact download name configurable.

Changes:

  • Build + upload the deploy-camunda binary in test-integration-template.yaml’s init job (with cache restore + conditional build).
  • Add a binary-artifact-name input to test-integration-runner.yaml and use it for the binary download in install/upgrade/cleanup jobs.
  • Pass the artifact name from the template workflow into the runner workflow.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
.github/workflows/test-integration-template.yaml Adds cache/build/upload steps for deploy-camunda and passes the artifact name to the runner workflow.
.github/workflows/test-integration-runner.yaml Adds binary-artifact-name input and uses it in the three download-artifact steps.

Comment on lines +347 to +353
- name: Upload deploy-camunda binary
uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7
with:
name: deploy-camunda-binary-${{ inputs.identifier }}
path: ~/.local/bin/deploy-camunda
if-no-files-found: error
retention-days: 1
Comment on lines 375 to 379
exclude: ${{ inputs.exclude }}
identifier: ${{ inputs.identifier }}-${{ inputs.shortname }}
binary-artifact-name: deploy-camunda-binary-${{ inputs.identifier }}
camunda-helm-repo: ${{ inputs.camunda-helm-repo }}
camunda-helm-dir: ${{ inputs.camunda-helm-dir }}
…trix

With the integration template now building and uploading the binary on
both entry paths (under a per-leg-unique name the runner downloads), the
static `deploy-camunda-binary` artifact produced by generate-chart-matrix
has no consumer. Remove the upload step to leave a single producer (the
template). The build/cache/PATH steps stay — generate-chart-matrix.sh
still prefers the compiled binary on PATH over `go run`.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@eamonnmoloney eamonnmoloney marked this pull request as draft June 24, 2026 05:22
@eamonnmoloney eamonnmoloney marked this pull request as ready for review June 24, 2026 05:49
@eamonnmoloney eamonnmoloney enabled auto-merge June 24, 2026 05:49
@eamonnmoloney eamonnmoloney added this pull request to the merge queue Jun 24, 2026
@eamonnmoloney eamonnmoloney removed this pull request from the merge queue due to a manual request Jun 24, 2026
@eamonnmoloney eamonnmoloney added this pull request to the merge queue Jun 24, 2026
Merged via the queue into main with commit b4b538f Jun 24, 2026
267 checks passed
@eamonnmoloney eamonnmoloney deleted the fix/nightly-deploy-camunda-binary-artifact-name branch June 24, 2026 10:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants