Standardize how to Run E2E tests in the OCP Test Infrastructure#332
Standardize how to Run E2E tests in the OCP Test Infrastructure#332dumb0002 wants to merge 2 commits intollm-d-incubation:mainfrom
Conversation
Signed-off-by: dumb0002 <Braulio.Dumba@ibm.com>
There was a problem hiding this comment.
Pull request overview
Standardizes how OpenShift (OCP) E2E tests are executed by introducing a dedicated test script, a Makefile entrypoint, and wiring the OpenShift CI workflow to run the script using workflow-created test objects.
Changes:
- Added
test/e2e/ocp-test.shto run launcher-based E2E scenarios against an OpenShift cluster using pre-created objects. - Added a Makefile target intended to run the full OCP E2E suite with configurable env vars.
- Updated the OpenShift CI workflow to pass object names via step outputs and invoke the Makefile target.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 7 comments.
| File | Description |
|---|---|
| test/e2e/ocp-test.sh | New OCP-focused E2E runner script that reuses workflow-created namespace and test objects. |
| Makefile | Adds an OCP E2E target and env var configuration for running the new script. |
| .github/workflows/ci-e2e-openshift.yaml | Adds a step to run the OCP E2E suite and passes object identifiers via step outputs. |
diegocastanibm
left a comment
There was a problem hiding this comment.
SO the PR is clear to me. My only concern is that @MikeSpreitzer mentioned in the meeting that he would like to use this script for local testing. As it is at this moment, the script cannot run locally. It depends on environment variables and pre-existing test objects that are created by earlier workflow steps. In contrast, test/e2e/run.sh is fully self-contained. If @MikeSpreitzer wants to use it locally, we can add a setup section so ocp-test.sh can be run independently against a local/remote cluster.
Other than that, LGTM. I just want to know what @MikeSpreitzer thinks about this
| fi | ||
|
|
||
| # Initialize launcher pod name from the launcher-config label | ||
| # The workflow has already verified the launcher pod exists and is bound to the requester |
There was a problem hiding this comment.
then this script depends on pre-existing test objects...
|
We want a script to run instead of, not in addition to, the scripting currently in that workflow |
@MikeSpreitzer (cc: @diegocastanibm), I suggest for us to break down everything into two scripts: What are your thoughts on this? |
You mean a script to run the E2E test suite, right? |
@MikeSpreitzer, yes! Similar to the script in this PR. |
That's just "deploy FMA", right? Adding the word "infra[structure]" is confusing to me. I think that you might be talking about the Kubernetes cluster and its users and their authorizations and other configuration. |
Yes, you're right, |
|
This PR is moot now, the matter has been handled by #386 . |
This PR standardize the procedure of how to run e2e tests in a OCP cluster.
Key changes:
test/e2e/ocp-test.shtargeting tests to be run in a OCP clusterocp-e2e-fullMakefile target with environment variable supportNAMESPACE,INST,ISC,LC,RSto test script via step outputscc: @diegocastanibm