Skip to content

Standardize how to Run E2E tests in the OCP Test Infrastructure#332

Closed
dumb0002 wants to merge 2 commits intollm-d-incubation:mainfrom
dumb0002:e2e-ocp-tests
Closed

Standardize how to Run E2E tests in the OCP Test Infrastructure#332
dumb0002 wants to merge 2 commits intollm-d-incubation:mainfrom
dumb0002:e2e-ocp-tests

Conversation

@dumb0002
Copy link
Copy Markdown
Collaborator

@dumb0002 dumb0002 commented Mar 9, 2026

This PR standardize the procedure of how to run e2e tests in a OCP cluster.

Key changes:

  • New test/e2e/ocp-test.sh targeting tests to be run in a OCP cluster
  • New ocp-e2e-full Makefile target with environment variable support
  • Workflow passes NAMESPACE, INST, ISC, LC, RS to test script via step outputs
  • Test script validates required environment variables and uses workflow-created objects

cc: @diegocastanibm

Copilot AI review requested due to automatic review settings March 9, 2026 22:36
Signed-off-by: dumb0002 <Braulio.Dumba@ibm.com>
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Standardizes how OpenShift (OCP) E2E tests are executed by introducing a dedicated test script, a Makefile entrypoint, and wiring the OpenShift CI workflow to run the script using workflow-created test objects.

Changes:

  • Added test/e2e/ocp-test.sh to run launcher-based E2E scenarios against an OpenShift cluster using pre-created objects.
  • Added a Makefile target intended to run the full OCP E2E suite with configurable env vars.
  • Updated the OpenShift CI workflow to pass object names via step outputs and invoke the Makefile target.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 7 comments.

File Description
test/e2e/ocp-test.sh New OCP-focused E2E runner script that reuses workflow-created namespace and test objects.
Makefile Adds an OCP E2E target and env var configuration for running the new script.
.github/workflows/ci-e2e-openshift.yaml Adds a step to run the OCP E2E suite and passes object identifiers via step outputs.

@MikeSpreitzer
Copy link
Copy Markdown
Collaborator

See also #336 and #337

Signed-off-by: dumb0002 <Braulio.Dumba@ibm.com>
@dumb0002 dumb0002 requested a review from diegocastanibm March 10, 2026 16:37
Copy link
Copy Markdown
Collaborator

@diegocastanibm diegocastanibm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SO the PR is clear to me. My only concern is that @MikeSpreitzer mentioned in the meeting that he would like to use this script for local testing. As it is at this moment, the script cannot run locally. It depends on environment variables and pre-existing test objects that are created by earlier workflow steps. In contrast, test/e2e/run.sh is fully self-contained. If @MikeSpreitzer wants to use it locally, we can add a setup section so ocp-test.sh can be run independently against a local/remote cluster.

Other than that, LGTM. I just want to know what @MikeSpreitzer thinks about this

fi

# Initialize launcher pod name from the launcher-config label
# The workflow has already verified the launcher pod exists and is bound to the requester
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

then this script depends on pre-existing test objects...

@MikeSpreitzer
Copy link
Copy Markdown
Collaborator

We want a script to run instead of, not in addition to, the scripting currently in that workflow

@dumb0002
Copy link
Copy Markdown
Collaborator Author

We want a script to run instead of, not in addition to, the scripting currently in that workflow

@MikeSpreitzer (cc: @diegocastanibm), I suggest for us to break down everything into two scripts:
    a) deploy_fma_infra.sh:  a script that deploys the dual-pod controller, requester, launcher pods, etc. (refractoring the scripting currently in the workflow)
    b) deploy_fma_e2e_tests.sh: a script to deploy the test scenarios (i.e., current script in this PR)

What are your thoughts on this?

@MikeSpreitzer
Copy link
Copy Markdown
Collaborator

 b) deploy_fma_e2e_tests.sh: a script to deploy the test scenarios (i.e., current script in this PR)

You mean a script to run the E2E test suite, right?

@dumb0002
Copy link
Copy Markdown
Collaborator Author

 b) deploy_fma_e2e_tests.sh: a script to deploy the test scenarios (i.e., current script in this PR)

You mean a script to run the E2E test suite, right?

@MikeSpreitzer, yes! Similar to the script in this PR.

@MikeSpreitzer
Copy link
Copy Markdown
Collaborator

MikeSpreitzer commented Mar 13, 2026

 a) deploy_fma_infra.sh:  a script that deploys the dual-pod controller, requester, launcher pods, etc. (refractoring the scripting currently in the workflow)

That's just "deploy FMA", right? Adding the word "infra[structure]" is confusing to me. I think that you might be talking about the Kubernetes cluster and its users and their authorizations and other configuration.

@dumb0002
Copy link
Copy Markdown
Collaborator Author

 a) deploy_fma_infra.sh:  a script that deploys the dual-pod controller, requester, launcher pods, etc. (refractoring the scripting currently in the workflow)

That's just "deploy FMA", right? Adding the word "infra[structure]" is confusing to me. I think that you might be talking about the Kubernetes cluster and its users and their authorizations and other configuration.

Yes, you're right, deploy_fma.sh is a more appropriate name for this script (cc: fyi @diegocastanibm )

@MikeSpreitzer
Copy link
Copy Markdown
Collaborator

This PR is moot now, the matter has been handled by #386 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants