Skip to content

chore(argocd): enable E2E coverage (e2e-test-utils 2.1.0)#2672

Open
gustavolira wants to merge 2 commits into
mainfrom
chore/e2e-coverage-argocd-2.1.0
Open

chore(argocd): enable E2E coverage (e2e-test-utils 2.1.0)#2672
gustavolira wants to merge 2 commits into
mainfrom
chore/e2e-coverage-argocd-2.1.0

Conversation

@gustavolira

Copy link
Copy Markdown
Member

Enables E2E coverage for the argocd workspace: bump @red-hat-developer-hub/e2e-test-utils to 2.1.0 + commit the Codecov anchors.

After /publish + /test e2e-ocp-helm, the e2e run uploads the e2e-argocd flag. Once it passes and reports coverage, we add its snapshot so the seed maintains it on the dashboard.

Part of the coverage rollout (after theme/global-header/bulk-import).

🤖 Generated with Claude Code

@gustavolira gustavolira requested review from a team, djanickova and dzemanov as code owners June 25, 2026 12:26
@github-actions github-actions Bot requested review from a team, gashcrumb and kadel as code owners June 25, 2026 13:46
@github-actions github-actions Bot added mandatory-workspace PR affects a workspace with required plugins for releases workspace-update PR modifies files in an existing workspace labels Jun 25, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Successfully updated file versions.jsonfrom branch main into this PR in commit 7cf38d0

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-community-plugin-argocd:pr_2672__2.8.0
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-community-plugin-argocd-backend:pr_2672__1.4.0

Backstage-incompatible workspaces

Some workspaces have a backstage version (in sources or in their overlay folder) which is incompatible with the target Backstage version (1.52.0).
1 incompatible workspaces, 0 of which are mandatory:

Folder Backstage version Mandatory Info
workspaces/argocd 1.49.2 BS Version History
How to fix

You have 3 main options:

  • Use the already-opened PR : For automatically-discovered workspaces, there might already be an automatically-opened PR that updates the commit to the target backstage version (Automatic PR link in column 4 above): just publish the plugins and test them from the PR by following the PR instructions.
  • Manually update the workspace commit :
    • Find a newer commit, with a backstage version compatible with the target backstage version :__*
      • Backstage version history available: A BS Version History link might be available in column 4: in the workspace source repository, it points to the list of commits touching the backstage.json file. This would help you finding out whether this workspace has a commit that has been published for the target backstage version.
      • No info available: If no information is is provided in column 4, the backstage.json probably does not exist in workspace sources. You would have to look deeper into the newer commits of workspace sources, possibly in the low-level dependencies in the package.json files, to find out a commit with an underlying backstage version compatible with the target backstage version.
    • Then, in the overlay repository, update the repo-ref field of the source.json file to the new source commit, and remember to also change the repo-backstage-version field to the corresponding compatible backstage version.
  • No compatible commit : If the workspace sources contain no compatible newer commit ( == a commit that provides a backstage.json version compatible with the target backstage), but the current workspace commit is known to work with the target backstage version, then you can override the declared backstage version compatibility for this workspace commit in the overlay repository using the /override-backstage command which will add a backstage.json file at the root of the overlay workspace folder with the desired target backstage version. This would require full testing of the workspace plugins on the target backstage though.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - argocd

Platform: ocp 4.18 | RHDH Version: 1.11 | Duration: 12m 58s
Passed: 0 | Failed: 1 | Flaky: 0 | Skipped: 6
Playwright Report | Build Log | Logs | Artifacts

@gustavolira

Copy link
Copy Markdown
Member Author

/update-commit

@github-actions

Copy link
Copy Markdown
Contributor

Update Commit workflow has completed with success.

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-community-plugin-argocd:pr_2672__2.8.0
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-community-plugin-argocd-backend:pr_2672__1.4.0

Backstage-incompatible workspaces

Some workspaces have a backstage version (in sources or in their overlay folder) which is incompatible with the target Backstage version (1.52.0).
1 incompatible workspaces, 0 of which are mandatory:

Folder Backstage version Mandatory Info
workspaces/argocd 1.49.2 BS Version History
How to fix

You have 3 main options:

  • Use the already-opened PR : For automatically-discovered workspaces, there might already be an automatically-opened PR that updates the commit to the target backstage version (Automatic PR link in column 4 above): just publish the plugins and test them from the PR by following the PR instructions.
  • Manually update the workspace commit :
    • Find a newer commit, with a backstage version compatible with the target backstage version :__*
      • Backstage version history available: A BS Version History link might be available in column 4: in the workspace source repository, it points to the list of commits touching the backstage.json file. This would help you finding out whether this workspace has a commit that has been published for the target backstage version.
      • No info available: If no information is is provided in column 4, the backstage.json probably does not exist in workspace sources. You would have to look deeper into the newer commits of workspace sources, possibly in the low-level dependencies in the package.json files, to find out a commit with an underlying backstage version compatible with the target backstage version.
    • Then, in the overlay repository, update the repo-ref field of the source.json file to the new source commit, and remember to also change the repo-backstage-version field to the corresponding compatible backstage version.
  • No compatible commit : If the workspace sources contain no compatible newer commit ( == a commit that provides a backstage.json version compatible with the target backstage), but the current workspace commit is known to work with the target backstage version, then you can override the declared backstage version compatibility for this workspace commit in the overlay repository using the /override-backstage command which will add a backstage.json file at the root of the overlay workspace folder with the desired target backstage version. This would require full testing of the workspace plugins on the target backstage though.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@rhdh-test-bot

Copy link
Copy Markdown

✅ Passed E2E Tests - argocd

Platform: ocp 4.18 | RHDH Version: 1.11 | Duration: 12m 8s
Passed: 7 | Failed: 0 | Flaky: 0 | Skipped: 0
Playwright Report | Build Log | Logs | Artifacts

@codecov

codecov Bot commented Jun 26, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 49.98%. Comparing base (bf1095d) to head (5074c14).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
Flag Coverage Δ
e2e-argocd 56.33% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Bump @red-hat-developer-hub/e2e-test-utils to 2.1.0 (coverage collector
fixture) and commit the static Codecov coverage anchors. After /publish +
/test the e2e run uploads the e2e-argocd flag.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@gustavolira

Copy link
Copy Markdown
Member Author

/override-backstage

@gustavolira gustavolira force-pushed the chore/e2e-coverage-argocd-2.1.0 branch from 5074c14 to 86f69c1 Compare June 30, 2026 18:15
@sonarqubecloud

Copy link
Copy Markdown

@gustavolira

Copy link
Copy Markdown
Member Author

/publish

@github-actions

Copy link
Copy Markdown
Contributor

Override Backstage workflow partially completed.

The backstage.json override to 1.52.0 was applied, but metadata files (OCI tags, supportedVersions) were not updated automatically. You can retry with /override-backstage or manually update the metadata files.

@github-actions

Copy link
Copy Markdown
Contributor

Publish workflow has completed with failure.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-community-plugin-argocd:pr_2672__2.8.0
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/backstage-community-plugin-argocd-backend:pr_2672__1.4.0

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

❌ Found 2 validation error(s):

File Kind Message
backstage-community-plugin-argocd-backend.yaml mismatch OCI tag mismatch: expected "bs_1.52.0__1.4.0" but got "bs_1.49.4__1.4.0"
backstage-community-plugin-argocd.yaml mismatch OCI tag mismatch: expected "bs_1.52.0__2.8.0" but got "bs_1.49.4__2.8.0"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

mandatory-workspace PR affects a workspace with required plugins for releases workspace-update PR modifies files in an existing workspace

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants