Skip to content

feat(e2e): orchestrator e2e tests#3562

Open
sanketpathak wants to merge 5 commits into
redhat-developer:mainfrom
sanketpathak:e2e-orchestrator-tests
Open

feat(e2e): orchestrator e2e tests#3562
sanketpathak wants to merge 5 commits into
redhat-developer:mainfrom
sanketpathak:e2e-orchestrator-tests

Conversation

@sanketpathak

Copy link
Copy Markdown
Contributor

Hey, I just made a Pull Request!

Playwright e2e tests to test the orchestrator workspace dev page https://redhat.atlassian.net/browse/RHIDP-14653

✔️ Checklist

  • A changeset describing the change and affected packages. (more info)
  • Added or Updated documentation
  • Tests for new functionality and regression tests for bug fixes
  • Screenshots attached (for UI changes)
Screenshot 2026-06-24 at 5 08 17 PM

@rhdh-gh-app

rhdh-gh-app Bot commented Jun 24, 2026

Copy link
Copy Markdown

Changed Packages

Package Name Package Path Changeset Bump Current Version
app-legacy workspaces/orchestrator/packages/app-legacy none v0.0.3
app workspaces/orchestrator/packages/app none v0.0.4

@github-actions

Copy link
Copy Markdown
Contributor

This pull request adds a new top-level directory under workspaces/. Please follow Submitting a Pull Request for a New Workspace in CONTRIBUTING.md.

@codecov

codecov Bot commented Jun 24, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 54.18%. Comparing base (e2df0a3) to head (161b5d6).
⚠️ Report is 11 commits behind head on main.
✅ All tests successful. No failed tests found.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3562      +/-   ##
==========================================
+ Coverage   54.02%   54.18%   +0.16%     
==========================================
  Files        2327     2331       +4     
  Lines       89215    89354     +139     
  Branches    25009    25046      +37     
==========================================
+ Hits        48194    48418     +224     
+ Misses      39567    39482      -85     
  Partials     1454     1454              
Flag Coverage Δ *Carryforward flag
adoption-insights 83.70% <ø> (ø) Carriedforward from 8c6c040
ai-integrations 67.95% <ø> (ø) Carriedforward from 8c6c040
app-defaults 69.79% <ø> (ø) Carriedforward from 8c6c040
augment 46.39% <ø> (ø) Carriedforward from 8c6c040
boost 74.35% <ø> (ø) Carriedforward from 8c6c040
bulk-import 72.46% <ø> (ø) Carriedforward from 8c6c040
cost-management 14.10% <ø> (ø) Carriedforward from 8c6c040
dcm 61.81% <ø> (ø) Carriedforward from 8c6c040
extensions 61.53% <ø> (ø) Carriedforward from 8c6c040
global-floating-action-button 71.18% <ø> (ø) Carriedforward from 8c6c040
global-header 59.71% <ø> (ø) Carriedforward from 8c6c040
homepage 49.84% <ø> (ø) Carriedforward from 8c6c040
install-dynamic-plugins 56.77% <ø> (ø) Carriedforward from 8c6c040
konflux 91.49% <ø> (ø) Carriedforward from 8c6c040
lightspeed 68.50% <ø> (ø) Carriedforward from 8c6c040
mcp-integrations 85.46% <ø> (ø) Carriedforward from 8c6c040
orchestrator 39.47% <ø> (+2.46%) ⬆️
quickstart 65.63% <ø> (ø) Carriedforward from 8c6c040
sandbox 79.56% <ø> (ø) Carriedforward from 8c6c040
scorecard 82.67% <ø> (ø) Carriedforward from 8c6c040
theme 61.26% <ø> (ø) Carriedforward from 8c6c040
translations 7.25% <ø> (ø) Carriedforward from 8c6c040
x2a 78.68% <ø> (ø) Carriedforward from 8c6c040

*This pull request uses carry forward flags. Click here to find out more.


Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e2df0a3...161b5d6. Read the comment docs.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@sanketpathak sanketpathak force-pushed the e2e-orchestrator-tests branch from 8e66186 to a3280d8 Compare June 24, 2026 12:37
@sanketpathak

Copy link
Copy Markdown
Contributor Author

This pr rhdhorchestrator/backstage-orchestrator-workflows#17 needs to be merged, to have sample-retry-test and test-ui-props tests working

@sanketpathak

Copy link
Copy Markdown
Contributor Author

/retest

@sanketpathak sanketpathak force-pushed the e2e-orchestrator-tests branch from a3280d8 to c7de015 Compare July 1, 2026 13:24
Comment thread workspaces/orchestrator/e2e-tests/pages/orchestrator.ts Outdated
Comment thread workspaces/orchestrator/e2e-tests/pages/orchestrator.ts Outdated
Comment thread workspaces/orchestrator/e2e-tests/pages/orchestrator.ts Outdated
Comment thread workspaces/orchestrator/e2e-tests/pages/orchestrator.ts Outdated
Comment on lines +39 to +44
if (!config.has('orchestrator.workflowLogProvider.loki')) {
logger.info(
'Loki workflow log provider is not configured, skipping module initialization',
);
return;
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this looks dangerous

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think i agree with @jrichter1 here. My thought here is that if the user needs to manually add this plugin, then they should also be responsible for adding this config and should see a proper error if they didn't add any config

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lholmquist So, for the tests to work, should I add orchestrator.workflowLogProvider.lokivalue in app-config to avoid the error, or do you suggest a different way, like having a different app-config-e2e for the test run

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you could just add the loki stuff to the app-config to avoid the error. it can just be some dummy values. you will need baseUrl and token https://github.com/redhat-developer/rhdh-plugin-export-overlays/blob/main/workspaces/orchestrator/metadata/rhdh-bsp-orchestrator-backend-mod-loki.yaml#L35

Comment thread workspaces/orchestrator/e2e-tests/orchestrator.test.ts Outdated
Comment thread workspaces/orchestrator/e2e-tests/pages/orchestrator.ts Outdated
Comment thread workspaces/orchestrator/e2e-tests/pages/orchestrator.ts
Comment thread workspaces/orchestrator/e2e-tests/utils/helper.ts Outdated
Comment thread workspaces/orchestrator/e2e-tests/utils/helper.ts Outdated
@sonarqubecloud

sonarqubecloud Bot commented Jul 3, 2026

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
5.1% Duplication on New Code (required ≤ 3%)
C Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants