Skip to content

E2E Visual Baselines #49

E2E Visual Baselines

E2E Visual Baselines #49

Triggered via schedule April 29, 2026 05:36
Status Success
Total duration 3m 13s
Artifacts 1

e2e-visual.yml

on: schedule
E2E Visual Baselines (Apache + MariaDB, non-blocking)
3m 9s
E2E Visual Baselines (Apache + MariaDB, non-blocking)
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 notice
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:222:9 β€Ί Visual regression baselines β€Ί VISN-04: admin bar node in expiring state baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L254
4) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:222:9 β€Ί Visual regression baselines β€Ί VISN-04: admin bar node in expiring state baseline Error: expect(page).toHaveScreenshot(expected) failed 5475 pixels (ratio 0.14 of all image pixels) are different. Snapshot: admin-bar-expiring.png Call log: - Expect "toHaveScreenshot(admin-bar-expiring.png)" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 5475 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 5475 pixels (ratio 0.14 of all image pixels) are different. 252 | // maxDiffPixels: 200 β€” tolerate timer-node width variation at mask boundary (same 253 | // rationale as VISN-03: .ab-label mask bounding box shifts slightly between runs). > 254 | await expect( page ).toHaveScreenshot( | ^ 255 | 'admin-bar-expiring.png', 256 | { 257 | clip: { x: 0, y: 0, width: 1280, height: 32 }, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:254:30
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L190
3) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) failed 5443 pixels (ratio 0.14 of all image pixels) are different. Snapshot: admin-bar-active.png Call log: - Expect "toHaveScreenshot(admin-bar-active.png)" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 5443 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 5443 pixels (ratio 0.14 of all image pixels) are different. 188 | // 200px is above the observed max drift (64px) and well below any real regression. 189 | // This baseline primarily asserts: WP Sudo node is visible with green background. > 190 | await expect( page ).toHaveScreenshot( | ^ 191 | 'admin-bar-active.png', 192 | { 193 | clip: { x: 0, y: 0, width: 1280, height: 32 }, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:190:30
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L190
3) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) failed 5443 pixels (ratio 0.14 of all image pixels) are different. Snapshot: admin-bar-active.png Call log: - Expect "toHaveScreenshot(admin-bar-active.png)" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 5443 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 5443 pixels (ratio 0.14 of all image pixels) are different. 188 | // 200px is above the observed max drift (64px) and well below any real regression. 189 | // This baseline primarily asserts: WP Sudo node is visible with green background. > 190 | await expect( page ).toHaveScreenshot( | ^ 191 | 'admin-bar-active.png', 192 | { 193 | clip: { x: 0, y: 0, width: 1280, height: 32 }, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:190:30
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L190
3) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline Error: expect(page).toHaveScreenshot(expected) failed 5443 pixels (ratio 0.14 of all image pixels) are different. Snapshot: admin-bar-active.png Call log: - Expect "toHaveScreenshot(admin-bar-active.png)" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 5443 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 5443 pixels (ratio 0.14 of all image pixels) are different. 188 | // 200px is above the observed max drift (64px) and well below any real regression. 189 | // This baseline primarily asserts: WP Sudo node is visible with green background. > 190 | await expect( page ).toHaveScreenshot( | ^ 191 | 'admin-bar-active.png', 192 | { 193 | clip: { x: 0, y: 0, width: 1280, height: 32 }, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:190:30
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L125
2) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('.wrap') Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. Snapshot: settings-form.png Call log: - Expect "toHaveScreenshot(settings-form.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.wrap') - locator resolved to <div class="wrap">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.wrap') - locator resolved to <div class="wrap">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. 123 | const muStatus = page.locator( '#wp-sudo-mu-status' ); 124 | > 125 | await expect( page.locator( '.wrap' ) ).toHaveScreenshot( | ^ 126 | 'settings-form.png', 127 | { 128 | threshold: 0.05, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:125:49
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L125
2) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('.wrap') Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. Snapshot: settings-form.png Call log: - Expect "toHaveScreenshot(settings-form.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.wrap') - locator resolved to <div class="wrap">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.wrap') - locator resolved to <div class="wrap">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. 123 | const muStatus = page.locator( '#wp-sudo-mu-status' ); 124 | > 125 | await expect( page.locator( '.wrap' ) ).toHaveScreenshot( | ^ 126 | 'settings-form.png', 127 | { 128 | threshold: 0.05, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:125:49
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L125
2) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('.wrap') Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. Snapshot: settings-form.png Call log: - Expect "toHaveScreenshot(settings-form.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.wrap') - locator resolved to <div class="wrap">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.wrap') - locator resolved to <div class="wrap">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different. 123 | const muStatus = page.locator( '#wp-sudo-mu-status' ); 124 | > 125 | await expect( page.locator( '.wrap' ) ).toHaveScreenshot( | ^ 126 | 'settings-form.png', 127 | { 128 | threshold: 0.05, at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:125:49
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L93
1) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('#wp-sudo-challenge-card') Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. Snapshot: challenge-card.png Call log: - Expect "toHaveScreenshot(challenge-card.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#wp-sudo-challenge-card') - locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#wp-sudo-challenge-card') - locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. 91 | await expect( card ).toBeVisible(); 92 | > 93 | await expect( card ).toHaveScreenshot( 'challenge-card.png', { | ^ 94 | threshold: 0.05, 95 | // maxDiffPixels not set β€” use threshold percentage for element clips 96 | } ); at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:93:30
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L93
1) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('#wp-sudo-challenge-card') Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. Snapshot: challenge-card.png Call log: - Expect "toHaveScreenshot(challenge-card.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#wp-sudo-challenge-card') - locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#wp-sudo-challenge-card') - locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. 91 | await expect( card ).toBeVisible(); 92 | > 93 | await expect( card ).toHaveScreenshot( 'challenge-card.png', { | ^ 94 | threshold: 0.05, 95 | // maxDiffPixels not set β€” use threshold percentage for element clips 96 | } ); at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:93:30
[chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline: tests/e2e/specs/visual/regression-baselines.spec.ts#L93
1) [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('#wp-sudo-challenge-card') Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. Snapshot: challenge-card.png Call log: - Expect "toHaveScreenshot(challenge-card.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#wp-sudo-challenge-card') - locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#wp-sudo-challenge-card') - locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different. 91 | await expect( card ).toBeVisible(); 92 | > 93 | await expect( card ).toHaveScreenshot( 'challenge-card.png', { | ^ 94 | threshold: 0.05, 95 | // maxDiffPixels not set β€” use threshold percentage for element clips 96 | } ); at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:93:30
🎭 Playwright Run Summary
4 failed [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 β€Ί Visual regression baselines β€Ί VISN-01: challenge page card element baseline [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 β€Ί Visual regression baselines β€Ί VISN-02: settings page form element baseline [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 β€Ί Visual regression baselines β€Ί VISN-03: admin bar node in active session state baseline [chromium-visual] β€Ί tests/e2e/specs/visual/regression-baselines.spec.ts:222:9 β€Ί Visual regression baselines β€Ί VISN-04: admin bar node in expiring state baseline

Artifacts

Produced during runtime
Name Size Digest
playwright-visual-report
49.5 MB
sha256:03a8e7f718b8dc1d8034e2be5f4abfce8e3431c8a47e9ca32329464e9bed1281