Drop the cardinality panel expectations and unskip PMM-T506 - #1275
Conversation
PMM-T506 expects a 'Time Series Information' row on the VictoriaMetrics dashboard holding 'Top 10 metrics by time series count' and 'Top 10 hosts by time series count'. percona/pmm#5822 deliberately removed both: their match-all selectors force a full index scan and can take a large server down. Drop them from the expected-metrics list. Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: Claude <noreply@anthropic.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (1)
🔗 Linked repositories identifiedCodeRabbit considers these linked repositories for cross-repo context during reviews:
💤 Files with no reviewable changes (1)
Included review availability: Your plan provides up to 1 included review per hour; 0 remain after this review. WalkthroughThe dashboard metric list removes Merge Risk: ⚪ Minimal · up to This change removes two dashboard expectations that no longer exist, without changing product behavior. No actionable merge-blocking risk remains beyond normal checks and review. 🚥 Pre-merge checks | ✅ 4✅ Passed checks (4 passed)
Full details: Description checkExplanation The description clearly explains that the test expectations were updated because PMM-15228 removed the two VictoriaMetrics cardinality panels. It also documents the failure, root cause, and verification. Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
LGTM! Gate gap, not a finding on the diff: nothing in CI covers this change. |
|
@claude unskip the test that we skipped because of this failure |
|
Claude finished @travagliad's task in 6m 28s —— View job Unskip PMM-T506 — blocked here, and it's a merge-order problem, not an edit
Where the skip is
// skip-until: 2026-09-29 -- cardinality panels removed by percona/pmm#5822; unskip via pmm-qa#1275, or when the panels return.
Scenario.skip(
'PMM-T506 - Verify metrics on VictoriaMetrics dashboard @nightly @dashboards @gssapi-nightly',That is the only skip attributable to this failure — a Why I can't just delete it hereThis branch forked before the skip landed (it's 77 files behind Fixing it requires
Two ways to land itEasiest — and it puts the last step back in my hands: click Update branch on this PR (that merge commit is yours, so the workflow-file restriction doesn't apply), then comment Or by hand: git fetch origin main
git switch claude/jolly-curie-dee5l7
git merge origin/main
# codeceptjs-e2e/tests/verifyVMDashboards_test.js: drop the skip-until comment,
# change Scenario.skip( back to Scenario(
git commit -am "Unskip PMM-T506 now the stale expectations are gone"
git pushMerging this PR first and unskipping in a two-line follow-up off Not doneNo commit was pushed: there was nothing on this branch to edit, and constructing the merge here isn't something this job can push. The diff under review is unchanged ( |
pmm-qa#1288 muted the test while the VictoriaMetrics panel question was open. This PR drops the two expectations the panels no longer satisfy, so the mute has done its job and is removed here rather than in a follow-up: merging the expectation fix alone would keep Scenario.skip (main added it after this branch forked) and leave the test dark. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SKRuqWTQVW4p6DDSYcFQEf Signed-off-by: Claude <noreply@anthropic.com>
Failures fixed (investigator)
Nightly E2E tests Matrix (remote PMM Server), jobtest execution / @nightly) — also red Aug 30 and Aug 31 on the same testcodeceptjs-e2e/tests/verifyVMDashboards_test.js:9/@nightly @dashboards @gssapi-nightly— PMM-T506 Verify metrics on VictoriaMetrics dashboardWhat failed
The only red job of 17, and the only actionable failure in it (Launchable gate:
1 actionable, 0 quarantined; 70 passed, 1 failed, 44 skipped):Root cause — a stale expectation, not a product bug
victoriaMetricsDashboard.metricsexpects aTime Series Informationrow holdingTop 10 metrics by time series countandTop 10 hosts by time series count.percona/pmm#5822 (PMM-15228, merged 2026-08-28)
removed both deliberately, along with the row — in Alex's words:
Their
{__name__=~".+"}selectors force a full index scan, and PMM raises VictoriaMetrics' ceilingspast where it would refuse them (
defaultVMSearchMaxUniqueTimeseries = "100000000",defaultVMSearchMaxSamplesPerQuery = "1500000000"—managed/services/supervisord/supervisord.go:52-53),so it runs them. Worst of all on the dashboard an operator opens when the server is already
struggling. The removal is intentional and justified, so the test is what needed updating.
Contents
1. Drop the two stale expectations (
dashboardPage.js) — the original fix.2. Unskip PMM-T506 (
verifyVMDashboards_test.js) — added after review.mainwas muted by #1288 while this PR's objection was being resolved. This branch forked beforethat landed, so in a three-way merge the base and this branch agree on the test file while
mainadded the skip — merging the expectation fix alone would have kept
Scenario.skip, leaving thetest dark and the nightly unchanged.
mainis now merged in and the skip removed on top, so onemerge both corrects the expectations and turns the test back on. The
skip-until: 2026-09-29markergoes with it, so #1288's lint tripwire has nothing dangling to fire on.
#1288's guard and weekly lint schedule stay in place for future skips. The separate follow-up PR
(#1310) is closed as redundant.
Verification
Reproduced on a throwaway Linode VM at
perconalab/pmm-server:3-dev-latest, digestsha256:fe34e198…— the identical image the failing nightly ran against. The Grafana API on thelive server confirms both panels absent:
Before/after on that VM:
mainFAIL— same step and stack frames as the nightly (dashboardPage.js:1201)OK | 1 passed // 1mOn this branch as it now stands:
mainis exactly the two intended changes, nothing else:-2indashboardPage.js,-2/+1inverifyVMDashboards_test.js.✖rather thanS— it executes instead of being skipped..js/.tsfiles carry askip-untilmarker; theskip-until expirycheck runs clean (rc=0).One honest caveat: nothing in this PR's CI runs the
@dashboardsscenario, so the green checks meannothing broke, not that the fix works — the VM before/after is the evidence for that, and the next
nightly is the confirmation under real CI conditions.
Note — not fixed here
prometheusDashboard(dashboardPage.js:115-116) carries the same two stale titles, but it is deadcode: nothing references it, and its URL
graph/d/prometheus/prometheusis a PMM 1.x dashboard thatno longer exists. Left alone to keep this diff minimal; worth deleting the whole unused block separately.
🤖 Generated with Claude Code
https://claude.ai/code/session_01SKRuqWTQVW4p6DDSYcFQEf