WIP feat(e2e): introduce e2e tests for bulk-import plugin#2494

Closed

PatAKnight wants to merge 49 commits into

redhat-developer:mainfrom

PatAKnight:update-bulk-import-tests

PatAKnight commented May 19, 2026

Member

Seeing if we are able to swap from Keycloak Auth to GitHub auth in PR #1972

PatAKnight requested review from a team, debsmita1, its-mitesh-kumar and rm3l as code owners

May 19, 2026 09:36

openshift-ci Bot added the do-not-merge/work-in-progress label

PatAKnight commented May 19, 2026

Member Author

/publish

1 similar comment

PatAKnight commented May 19, 2026

Member Author

/publish

github-actions Bot commented May 19, 2026

Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

Published container images:
- ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_2494__7.3.4
- ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import-backend:pr_2494__7.3.4

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.49.4).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

github-actions Bot commented May 19, 2026

Contributor

Publish workflow has completed with failure.

Publishing process

❌ Plugins with errors during export or container image publishing:

plugins/bulk-import-backend
Published container images:
- ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_2494__7.3.4

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.49.4).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 7m 7s
Passed: 0 | Failed: 3 | Flaky: 0 | Skipped: 9
Playwright Report | Build Log | Logs | Artifacts

PatAKnight commented May 19, 2026

Member Author

/test e2e-ocp-helm

github-actions Bot added mandatory-workspace workspace-update labels

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 7m 21s
Passed: 0 | Failed: 3 | Flaky: 0 | Skipped: 9
Playwright Report | Build Log | Logs | Artifacts

PatAKnight force-pushed the update-bulk-import-tests branch from 2301482 to 8981b95 Compare

May 19, 2026 11:03

PatAKnight commented May 19, 2026

Member Author

/publish

github-actions Bot commented May 19, 2026

Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

Published container images:
- ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_2494__7.3.5
- ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import-backend:pr_2494__7.3.5

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.49.4).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

github-actions Bot commented May 19, 2026

Contributor

✅ Smoke tests workflow passed. All plugins loaded successfully.

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 45m 11s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts

PatAKnight commented May 19, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 10m 41s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts

PatAKnight commented May 19, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 15m 36s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts

PatAKnight commented May 19, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 12m 52s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts

PatAKnight commented May 19, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 14m 37s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts

PatAKnight commented May 19, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 19, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 14m 19s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts

PatAKnight added 5 commits

May 19, 2026 21:13


          feat(e2e): attempt to wait of initial github popup

c8ac580

Signed-off-by: Patrick Knight <pknight@redhat.com>


          feat(e2e): swap isVisible with toBeVisible

f8daf10

Signed-off-by: Patrick Knight <pknight@redhat.com>


          feat(e2e): remove or for toBeVisible

af9aa91

Signed-off-by: Patrick Knight <pknight@redhat.com>


          feat(e2e): attempt to wait for the popup

77ad2b6

Signed-off-by: Patrick Knight <pknight@redhat.com>


          feat(e2e): handle gitlab auth popup as well

b2f7173

Signed-off-by: Patrick Knight <pknight@redhat.com>

PatAKnight force-pushed the update-bulk-import-tests branch from 632a096 to b2f7173 Compare

May 20, 2026 01:13

PatAKnight commented May 20, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 41m 13s
Passed: 1 | Failed: 4 | Flaky: 0 | Skipped: 7
Playwright Report | Build Log | Logs | Artifacts


          feat(e2e): handle auth across tests

4c0c9c8

Signed-off-by: Patrick Knight <pknight@redhat.com>

AndrienkoAleksandr commented May 20, 2026

Contributor

/test e2e-ocp-helm

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 39m 4s
Passed: 2 | Failed: 3 | Flaky: 0 | Skipped: 7
Playwright Report | Build Log | Logs | Artifacts

PatAKnight added 2 commits

May 20, 2026 08:40


          feat(e2e): bump test utils and simplify beforeEach

d8affcb

Signed-off-by: Patrick Knight <pknight@redhat.com>


          feat(e2e): reject gitlab login for orchestrator tests

4beabac

Signed-off-by: Patrick Knight <pknight@redhat.com>

PatAKnight commented May 20, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 8m 10s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts


          feat(e2e): simplify the auth utils

43b7fc9

Signed-off-by: Patrick Knight <pknight@redhat.com>

PatAKnight commented May 20, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 10m 4s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts


          feat(e2e): some more simplifying

c35684b

Signed-off-by: Patrick Knight <pknight@redhat.com>

PatAKnight commented May 20, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 14m 56s
Passed: 0 | Failed: 4 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts


          feat(e2e): handle github pop up again

fedea15

Signed-off-by: Patrick Knight <pknight@redhat.com>

PatAKnight commented May 20, 2026

Member Author

/test e2e-ocp-helm

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 14m 46s
Passed: 1 | Failed: 3 | Flaky: 0 | Skipped: 8
Playwright Report | Build Log | Logs | Artifacts


          feat(e2e): better handle the popups

ece1409

Signed-off-by: Patrick Knight <pknight@redhat.com>

PatAKnight commented May 20, 2026

Member Author

/test e2e-ocp-helm

sonarqubecloud Bot commented May 20, 2026

Quality Gate failed

Failed conditions
1 Security Hotspot

See analysis details on SonarQube Cloud

rhdh-test-bot commented May 20, 2026

❌ Failed E2E Tests - `bulk-import`

Platform: ocp 4.18 | RHDH Version: 1.10 | Duration: 13m 44s
Passed: 7 | Failed: 2 | Flaky: 0 | Skipped: 3
Playwright Report | Build Log | Logs | Artifacts

openshift-ci Bot commented May 20, 2026

@PatAKnight: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-ocp-helm	`ece1409`	link	false	`/test e2e-ocp-helm`

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

PatAKnight closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Labels

do-not-merge/work-in-progress mandatory-workspace workspace-update