Cypress e2e - Github Actions - Autotrigger after successful test.yml execution (non-gating) (opendatahub-io#5518)

* Update testUserLogin.cy.ts

* Update pipelines.cy.ts

* Update testClusterStorageCreation.cy.ts

* Update testConnectionCreation.cy.ts

* Update testModelStopStart.cy.ts

* Update workbenches.cy.ts

* Update testProjectCreation.cy.ts

* Update testAdminClusterSettings.cy.ts

* Update cypress-e2e-test.yml

* Update package.json

* Update package.json

* Update package.json

* Update cypress-e2e-test.yml

* Update cypress-e2e-test.yml

* Update package.json

* Update package.json

* Removing Electron from package.json

* Update workbenches.cy.ts

* Update testModelStopStart.cy.ts

* Dynamic Port Logic Added

* Additional Debugging for Cypress failing to connect to Chrome

* Additional debugging for chrome browser

* Fixed --browser-args

* Further additional debugging

* Revert to use 4010

* Reverted to working version with dynamic port

* Pass baseUrl via --config

* Setting ODH_DASHBOARD_URL to http://localhost:${CYPRESS_PORT}

* Added replacement of all occurences of dashboard_url

* Make ODH_DASHBOARD_URL Global

* Dynamic Port Change to Test Matrix

* Test Variables Update

* Reverting to Friday's version

* Reverting to Friday's version 2

* Nested ODH_Dashboard_URL update

* Root level ODH_Dashboard_URL change

* ODH_PORT change 2

* added chrome back

* additional cleanup added

* Additional debugging and xfvb checks

* Remved XFVB Calcs

* Switching back to electron

* Switching back to electron

* FD Limit Increase

* Reverting to working version

* Removing checkout of current branch

* Updated cypress execution command to use localhost

* Minimal test config update

* Added Cypress Debugging

* Running 1 tag with debugging

* Added WDS_SOCKET_PORT=${CYPRESS_PORT}

* Update webpack.dev.js to specify port

* Minor change to accomodate webpack changes

* Additional webpack.dev.js updates

* XFVB changes

* Remved xfvb

* Added additional logging to webpack

* Adding additional logging

* Webpack IPv4 changes

* Port cleanup change

* Adding export Base_URL

* Added Cypress and Base URLs

* Test-variables command update

* Updated base_url

* Cypress debug and Video Disable

* Addeed DEBUG=cypress:server

* Removed Cypress Debugging

* Reverting webpack.dev.js changes

* Renabling chrome

* Removed cluster detail

* Fix js-yaml import in testProjectCreation.cy.ts and update test tags

* Fix TypeScript path mapping for #~/ alias in Cypress tsconfig

* Revert TypeScript path mapping change - leave as is in main

* feat: override RHOAI namespaces with ODH values from GitHub secret

- Add step to override namespace values from ODH_NAMESPACES secret
- Parse comma-separated values: OPERATOR_NAMESPACE,APPLICATIONS_NAMESPACE,NOTEBOOKS_NAMESPACE,OPERATOR_NAME,ODH_DASHBOARD_PROJECT_NAME
- Mask secret values in logs for security
- Add description noting workflow only supports ODH dash-e2e pipeline currently
- Switch from Electron to Chrome browser for Cypress tests

* feat: improve E2E workflow for multi-user parallel execution

- Improve port allocation: use modulo 1000 with 5-port spacing (1000 possible ports)
- Add port ownership tracking with run_id files to prevent collisions
- Remove Cypress dependencies installation step (managed on runners)
- Add port ownership checking before killing processes (prevents killing other users' jobs)
- Enable video recording on test failure (videoUploadOnPasses: false)
- Improve cleanup job: only kill processes owned by current run_id
- Add Chrome process cleanup to prevent orphaned browser processes
- Add alternative port finding if primary port is owned by another run

These changes ensure the workflow can safely handle up to 5 users running
pipelines in parallel without port collisions or process interference.

* fix: remove invalid videoUploadOnPasses Cypress config option

Cypress automatically uploads videos on failure by default when video=true,
so the videoUploadOnPasses option is not needed and is invalid.

* fix: add timeouts to cache operations to prevent hanging

- Add timeout-minutes: 10 to npm dependencies cache (largest cache)
- Add timeout-minutes: 5 to turbo and oc cache steps
- Add continue-on-error: true to all cache steps to prevent job failure
- Add job-level timeout-minutes: 30 to prevent jobs from hanging indefinitely

This addresses jobs getting stuck during post-job cache cleanup,
particularly when multiple jobs run in parallel and try to save large caches.

* fix: use restore-only caching to eliminate save conflicts

- Convert all cache steps to actions/cache/restore@v4 (read-only)
- Remove cache save operations that were causing 3-5 minute post-job delays
- Jobs still benefit from cache when available, but won't update it
- Eliminates 'Unable to reserve cache' conflicts from parallel jobs

* chore: linting fixes

* feat: trigger E2E tests after test.yml with concurrency and label support

- Change trigger from push/PR to workflow_run after test.yml completes
- Add PR-aware concurrency control (e2e-pr-{number} for PRs, e2e-branch-{name} for branches)
- Only latest E2E run executes per PR/branch (cancels in-progress runs)
- Add label update job (e2e-Pass/e2e-Fail) based on test results
- Checkout PR code using refs/pull/{number}/head format
- E2E results do not gate code merging (non-blocking)

* feat: improve E2E workflow fork support and documentation

- Add test names in comments for @ci-dashboard-set-1 and @ci-dashboard-set-2
- Update checkout comment to clarify fork PR support
- Align secret handling with current implementation (graceful fallback)
- Add ODH_DASHBOARD_URL fallback to localhost for fork PRs

Author: antowaddle

.github/workflows/cypress-e2e-test.yml

@@ -49,6 +49,7 @@
     "cypress:run:mock:coverage": "rimraf src/__tests__/cypress/coverage src/__tests__/cypress/.nyc_output && CY_COVERAGE=true npm run cypress:run:mock -- {@}",
     "cypress:open:record": "CY_RECORD=1 npm run cypress:open",
     "cypress:run:electron": "cypress run -b electron --project src/__tests__/cypress",
+    "cypress:run:chrome": "cypress run -b chrome --project src/__tests__/cypress",
     "cypress:run:record": "CY_RECORD=1 npm run cypress:run && npm run cypress:format",
     "cypress:server:build": "MF_DEV=true ODH_DIST_DIR=./public-cypress POLL_INTERVAL=9999999 FAST_POLL_INTERVAL=9999999 WS_HOSTNAME=localhost:9002 npm run build",
     "cypress:server:build:coverage": "COVERAGE=true npm run cypress:server:build",

frontend/package.json

@@ -34,7 +34,7 @@ describe(
 
     it(
       'An admin User can Import and Run a Pipeline',
-      { tags: ['@Smoke', '@SmokeSet1', '@Dashboard', '@Pipelines', '@Bug'] },
+      { tags: ['@Smoke', '@SmokeSet1', '@Dashboard', '@Pipelines', '@ci-dashboard-set-1', '@Bug'] },
       () => {
         cy.step('Navigate to Pipelines ${projectName}');
         cy.visitWithLogin('/', HTPASSWD_CLUSTER_ADMIN_USER);

frontend/src/__tests__/cypress/cypress/tests/e2e/Pipelines/pipelines.cy.ts

@@ -7,7 +7,7 @@ import { header } from '#~/__tests__/cypress/cypress/pages/components/Header';
 describe('Verify that logged in users display on the Dashboard', () => {
   it(
     'Verify that Admin Users can login and that login information displays on the dashboard',
-    { tags: ['@Sanity', '@SanitySet2', '@ODS-354', '@Dashboard'] },
+    { tags: ['@Sanity', '@SanitySet2', '@ODS-354', '@Dashboard', '@ci-dashboard-set-1'] },
     () => {
       // Authentication and navigation
       cy.step('Log into the application');

frontend/src/__tests__/cypress/cypress/tests/e2e/dashboardNavigation/testUserLogin.cy.ts

@@ -70,7 +70,7 @@ describe('Verify Cluster Storage - Creating, Editing and Deleting', () => {
 
   it(
     'Create, Edit and Delete a Persistent Volume Storage',
-    { tags: ['@Sanity', '@SanitySet1', '@ODS-1824', '@Dashboard'] },
+    { tags: ['@Sanity', '@SanitySet1', '@ODS-1824', '@Dashboard', '@ci-dashboard-set-2'] },
     () => {
       // Authentication and navigation
       cy.step('Log into the application');

frontend/src/__tests__/cypress/cypress/tests/e2e/dataScienceProjects/clusterStorage/testClusterStorageCreation.cy.ts

@@ -56,7 +56,7 @@ describe('Verify Connections - Creation and Deletion', () => {
 
   it(
     'Create and Delete a Connection',
-    { tags: ['@Sanity', '@SanitySet1', '@ODS-1826', '@Dashboard'] },
+    { tags: ['@Sanity', '@SanitySet1', '@ODS-1826', '@Dashboard', '@ci-dashboard-set-2'] },
     () => {
       // Authentication and navigation
       cy.step('Log into the application');

frontend/src/__tests__/cypress/cypress/tests/e2e/dataScienceProjects/connections/testConnectionCreation.cy.ts

@@ -57,7 +57,15 @@ describe('[Product Bug: RHOAIENG-38674] A model can be stopped and started', ()
   it(
     'Verify that a model can be stopped and started',
     {
-      tags: ['@Smoke', '@SmokeSet3', '@Dashboard', '@ModelServing', '@NonConcurrent', '@Bug'],
+      tags: [
+        '@Smoke',
+        '@SmokeSet3',
+        '@Dashboard',
+        '@ModelServing',
+        '@NonConcurrent',
+        '@ci-dashboard-set-2',
+        '@Bug',
+      ],
     },
     () => {
       cy.log('Model Name:', modelName);

frontend/src/__tests__/cypress/cypress/tests/e2e/dataScienceProjects/models/testModelStopStart.cy.ts

@@ -1,4 +1,4 @@
-import yaml from 'js-yaml';
+import * as yaml from 'js-yaml';
 import { HTPASSWD_CLUSTER_ADMIN_USER } from '#~/__tests__/cypress/cypress/utils/e2eUsers';
 import {
   projectListPage,
@@ -55,7 +55,17 @@ describe('Verify Project - Creation and Deletion', () => {
 
   it(
     'Create and Delete a Project in RHOAI',
-    { tags: ['@Smoke', '@SmokeSet2', '@ODS-1875', '@ODS-1783', '@ODS-1775', '@Dashboard'] },
+    {
+      tags: [
+        '@Smoke',
+        '@SmokeSet2',
+        '@ODS-1875',
+        '@ODS-1783',
+        '@ODS-1775',
+        '@Dashboard',
+        '@ci-dashboard-set-1',
+      ],
+    },
     () => {
       // Authentication and navigation
       cy.step('Log into the application');

frontend/src/__tests__/cypress/cypress/tests/e2e/dataScienceProjects/testProjectCreation.cy.ts

@@ -74,7 +74,16 @@ describe('Workbench and PVSs tests', () => {
 
   it(
     'Verify users can create a workbench and connect an existent PersistentVolume',
-    { tags: ['@Smoke', '@SmokeSet1', '@ODS-1814', '@Dashboard', '@Workbenches'] },
+    {
+      tags: [
+        '@Smoke',
+        '@SmokeSet1',
+        '@ODS-1814',
+        '@Dashboard',
+        '@Workbenches',
+        '@ci-dashboard-set-1',
+      ],
+    },
     () => {
       const workbenchName = projectName.replace('dsp-', '');
       let selectedImageStream: string;

frontend/src/__tests__/cypress/cypress/tests/e2e/dataScienceProjects/workbenches/workbenches.cy.ts

@@ -64,7 +64,7 @@ describe('Verify that only the Cluster Admin can access Cluster Settings', () =>
 
   it(
     'Admin should access Cluster Settings and see UI fields matching OpenShift configurations',
-    { tags: ['@Smoke', '@SmokeSet2', '@ODS-1216', '@Dashboard'] },
+    { tags: ['@Smoke', '@SmokeSet2', '@ODS-1216', '@Dashboard', '@ci-dashboard-set-2'] },
     () => {
       // Authentication and navigation
       cy.step('Log into the application');