Skip to content

docs(ai): add test-placement skill for the plugin testing strategy (RHIDP-13501)#5045

Open
gustavolira wants to merge 2 commits into
redhat-developer:mainfrom
gustavolira:rhidp-13501-test-placement-skill
Open

docs(ai): add test-placement skill for the plugin testing strategy (RHIDP-13501)#5045
gustavolira wants to merge 2 commits into
redhat-developer:mainfrom
gustavolira:rhidp-13501-test-placement-skill

Conversation

@gustavolira

@gustavolira gustavolira commented Jul 2, 2026

Copy link
Copy Markdown
Member

Summary

Adds a test-placement AI-assistant skill (Claude Code / Cursor / OpenCode, generated via rulesync): when a developer asks "where should I test this?", the assistant gathers the context and proposes the right repo (rhdh-plugins / rhdh-plugin-export-overlays / rhdh), the right layer (L1 unit → L4b cluster e2e), the location, and how to scaffold the test.

It encodes the per-repository testing responsibility split consolidated on epic RHIDP-13501 (and its attached rhdh-dynamic-plugin-testing-guideline.md):

  • Decision table: source bugs → rhdh-plugins · artifact bugs → overlays · integration/render bugs → rhdh · platform bugs → cluster e2e.
  • Capability ladder — cheapest environment that catches the bug wins; most plugin validation needs no cluster, and a growing part needs no Docker.
  • Concrete scaffolding steps per placement, including how to enable a spec on the cluster-free harness (feat(e2e): cluster-free local E2E harness (legacy app, Tier B) #5005) and when the overlays native smoke (overlays#2714) applies.
  • The researched "not possible today" list, so devs don't burn time on dead ends.

A sibling PR adds the same skill to rhdh-plugins and rhdh-plugin-export-overlays (.claude/skills/), so the guidance is available wherever the developer is working.

Notes

Related

Epic RHIDP-13501 · Harness #5005 (RHIDP-15075) · Matrix #5044 (RHIDP-15076) · Sanity #4967 · Overlays native smoke rhdh-plugin-export-overlays#2714

🤖 Generated with Claude Code

… ecosystem

Adds an AI-assistant skill that, given the context of a change or bug,
proposes the right repository (rhdh-plugins / rhdh-plugin-export-overlays /
rhdh), the right test layer (L1 unit -> L4b cluster e2e), the location, and
how to scaffold the test. Encodes the per-repo testing responsibility split
consolidated on epic RHIDP-13501 (decision table, capability ladder,
known-impossible list) so the cheapest environment that catches the bug is
picked by default.

Source in .rulesync/skills; .claude/.cursor/.opencode generated via
rulesync 7.30.0.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@openshift-ci openshift-ci Bot requested review from elsony and imykhno July 2, 2026 19:40
@codecov

codecov Bot commented Jul 2, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 54.77%. Comparing base (d8b493f) to head (e451060).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5045      +/-   ##
==========================================
- Coverage   55.39%   54.77%   -0.62%     
==========================================
  Files         122      110      -12     
  Lines        2365     2147     -218     
  Branches      544      518      -26     
==========================================
- Hits         1310     1176     -134     
+ Misses       1049      970      -79     
+ Partials        6        1       -5     
Flag Coverage Δ
rhdh 54.77% <ø> (-0.62%) ⬇️

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d8b493f...e451060. Read the comment docs.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

…tion, path prefixes

- Mark harnesses that are still in review and instruct the assistant to
  verify paths exist on main before recommending them (the skill referenced
  redhat-developer#5005/redhat-developer#5044/redhat-developer#2714/redhat-developer#4967 deliverables in present tense).
- Describe the overlays native smoke's real interface: yarn smoke
  --dynamic-plugins <file> [--out] (no --workspace flag exists; the harness
  does not read workspaces/*/metadata — a workspace run is a dp.yaml listing
  its oci:// refs).
- Replace the fork-only RHIDP-13235-layer3-component-tests branch pointer
  with the closed PR rhdh#4864.
- Prefix every path with its repo (rhdh:/overlays:/plugins:) and use full
  URLs for cross-repo docs, so the skill resolves from any of its three homes.
- Fix skopeo claim: it installs on macOS via brew; CI has it preinstalled.
- Name the Docker smoke location (overlays smoke-tests/ +
  run-workspace-smoke-tests.yaml), replace the vague "any" repo cell, use
  "n/a (cluster)" for the cluster row's Docker column, move PR numbers to
  References with status, add trigger phrases to the frontmatter description,
  and deduplicate the guiding-rule sentence.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

The container image build workflow finished with status: cancelled.

@sonarqubecloud

sonarqubecloud Bot commented Jul 2, 2026

Copy link
Copy Markdown

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant