Skip to content

[release-1.9] fix(e2e): fix orchestrator workflow deployment#4979

Merged
openshift-merge-bot[bot] merged 8 commits into
redhat-developer:release-1.9from
rostalan:fix/rhdhbugs-3383-release-1.9
Jun 25, 2026
Merged

[release-1.9] fix(e2e): fix orchestrator workflow deployment#4979
openshift-merge-bot[bot] merged 8 commits into
redhat-developer:release-1.9from
rostalan:fix/rhdhbugs-3383-release-1.9

Conversation

@rostalan

@rostalan rostalan commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Description

On 1.9, orchestrator tests fail with timeout error, because workflow images do not exist.
This PR changes OSL channel from logic-operator-rhel8:alpha to logic-operator:stable and pins it to 1.37.2.
It also pins workflow images to 1.37.
And also unskips some skipped orchestrator jobs for 1.9.
And it also removes check for non-existing UI element that failed the tests (RHDHBUGS-3363)

Which issue(s) does this PR fix

Fixes RHDHBUGS-3383
Also fixes RHDHBUGS-3363

PR acceptance criteria

Please make sure that the following steps are complete:

  • GitHub Actions are completed and successful
  • Unit Tests are updated and passing
  • E2E Tests are updated and passing
  • Documentation is updated if necessary (requirement for new features)
  • Add a screenshot if the change is UX/UI related

How to test changes / Special notes to the reviewer

Pin workflow manifests to a known-good commit so CI does not drift to unavailable OSL image tags and fail failswitch rollout with timeout.
@openshift-ci

openshift-ci Bot commented Jun 22, 2026

Copy link
Copy Markdown

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@rostalan rostalan changed the title fix: pin serverless-workflows ref on release-1.9 fix(e2e): pin serverless-workflows ref on release-1.9 Jun 22, 2026
@rostalan rostalan changed the title fix(e2e): pin serverless-workflows ref on release-1.9 fix(e2e): [release-1.9] pin serverless-workflows ref Jun 22, 2026
@rostalan rostalan changed the title fix(e2e): [release-1.9] pin serverless-workflows ref [release-1.9] fix(e2e): pin serverless-workflows ref Jun 22, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

@rostalan

Copy link
Copy Markdown
Contributor Author

/test all

@rostalan rostalan marked this pull request as ready for review June 22, 2026 13:23
@openshift-ci openshift-ci Bot requested review from HusneShabbir and josephca June 22, 2026 13:23
@rostalan

Copy link
Copy Markdown
Contributor Author

/retest

@rostalan

This comment was marked as spam.

@rostalan

This comment was marked as spam.

@rostalan

Copy link
Copy Markdown
Contributor Author

/test e2e-ocp-helm

@rostalan

This comment was marked as spam.

@lholmquist

Copy link
Copy Markdown
Member

@rostalan i recently push updated images for these four workflows and tagged them as osl_1_38

i'm not sure if those are the workflows that were timing out or not. i know there was another slack thread that mentioned those

@rostalan

Copy link
Copy Markdown
Contributor Author

@rostalan i recently push updated images for these four workflows and tagged them as osl_1_38

* [serverless-workflow-greeting](https://quay.io/repository/orchestrator/serverless-workflow-greeting)

* [serverless-workflow-sample-retry-test](https://quay.io/repository/orchestrator/serverless-workflow-sample-retry-test)

* [serverless-workflow-test-object-type-uiprops](https://quay.io/repository/orchestrator/serverless-workflow-test-object-type-uiprops)

* [fail-switch](https://quay.io/repository/orchestrator/fail-switch)

i'm not sure if those are the workflows that were timing out or not. i know there was another slack thread that mentioned those

Hey @lholmquist, thanks,
I am not sure this helps here, since the release-1.9 branch is still using osl 1.36.1 (via alpha channel of logic-operator-rhel8) and the decision was made yesterday to pin it to 1.37.

It might however have an impact for main and 1.10, where we are currently resolving to osl 1.38 afaik.
Not sure if there are any guards/warnings in place against using older workflow images (probably no?) and not sure how compatible the older images are with newer osl, since we keep seeing a lot of orchestrator related failures recently.

Will update this PR to pin the osl version to 1.37.2.

Allow install_subscription to accept an optional startingCSV and use it to install logic-operator from the stable channel pinned to logic-operator.v1.37.2 on release-1.9.
@github-actions

Copy link
Copy Markdown
Contributor

The container image build workflow finished with status: cancelled.

@rostalan rostalan changed the title [release-1.9] fix(e2e): pin serverless-workflows ref [release-1.9] fix(e2e): fix orchestrator workflow deployment Jun 24, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

@polasudo

Copy link
Copy Markdown
Member

CI Medic: Root Cause Analysis

The pull-ci-redhat-developer-rhdh-release-1.9-e2e-ocp-helm job failed before any tests ran.

Root cause: .ci/pipelines/utils.sh line 381 references bare $7 (starting_csv=$7) but 4 of 5 callers of install_subscription() only pass 6 arguments. With set -o nounset (set in openshift-ci-tests.sh line 5), this is a fatal "unbound variable" error.

The crash happened during OpenShift Pipelines operator installation (install_pipelines_operator at line 968), which calls install_subscription with only 6 args.

Callers affected:

Line Caller Args
457 install_crunchy_postgres_ocp_operator 6 (crashes)
480 install_crunchy_postgres_k8s_operator 6 (crashes)
503 install_serverless_logic_ocp_operator 7 (OK)
513 install_serverless_ocp_operator 6 (crashes)
968 install_pipelines_operator 6 (crashes)

Fix: Change line 381 from:

starting_csv=$7

to:

starting_csv=${7:-}

This makes the 7th parameter optional with an empty default, which is the correct behavior since only the serverless logic operator needs CSV pinning.

rostalan added 2 commits June 24, 2026 13:08
Stop excluding orchestrator specs in pull e2e-ocp-helm runs while keeping existing skips for osd-gcp and non-OpenShift environments.
Log the installed logic-operator CSV/version and the serverless-workflows ref/commit used during workflow deployment to speed up timeout triage.
@rostalan rostalan force-pushed the fix/rhdhbugs-3383-release-1.9 branch from 1b96889 to 903d8d2 Compare June 24, 2026 11:10
@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

@rostalan rostalan force-pushed the fix/rhdhbugs-3383-release-1.9 branch from fbce4dd to 27dca80 Compare June 24, 2026 12:54
@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

Keep completed status validation focused on the Completed icon and completion timestamp, and poll for stabilization to reduce UI flakiness.
@rostalan rostalan force-pushed the fix/rhdhbugs-3383-release-1.9 branch from 4c49f0c to 23ab2b6 Compare June 24, 2026 13:38
@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

Comment thread e2e-tests/playwright/support/pages/orchestrator.ts
Comment thread e2e-tests/playwright/e2e/plugins/orchestrator/failswitch-workflow.spec.ts Outdated
Comment thread .ci/pipelines/utils.sh Outdated
Comment thread .ci/pipelines/utils.sh Outdated
Comment thread .ci/pipelines/utils.sh Outdated
Comment thread e2e-tests/playwright/e2e/plugins/orchestrator/greeting-workflow.spec.ts Outdated
Comment thread e2e-tests/playwright/e2e/plugins/orchestrator/failswitch-workflow.spec.ts Outdated
Make workflow ref checkout fail fast and configurable, reduce failswitch test flakiness with safer restart/polling behavior, and prevent env clobbering when HTTPBIN patch pre-read fails.
@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

Avoid readonly reassignment errors when utils.sh is sourced multiple times by initializing SERVERLESS_WORKFLOWS_DEFAULT_REF once before marking it readonly.
@github-actions

Copy link
Copy Markdown
Contributor

The container image build and publish workflows were skipped (either due to [skip-build] tag or no relevant changes with existing image).

@rostalan rostalan requested a review from gustavolira June 25, 2026 06:37
@rostalan

Copy link
Copy Markdown
Contributor Author

/test e2e-ocp-helm

@openshift-ci openshift-ci Bot added the lgtm label Jun 25, 2026
@openshift-merge-bot openshift-merge-bot Bot merged commit dbcbafa into redhat-developer:release-1.9 Jun 25, 2026
19 checks passed
@sonarqubecloud

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants