E2E Visual Baselines #49
e2e-visual.yml
on: schedule
E2E Visual Baselines (Apache + MariaDB, non-blocking)
3m 9s
Annotations
10 errors and 1 notice
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:222:9 βΊ Visual regression baselines βΊ VISN-04: admin bar node in expiring state baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L254
4) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:222:9 βΊ Visual regression baselines βΊ VISN-04: admin bar node in expiring state baseline
Error: expect(page).toHaveScreenshot(expected) failed
5475 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: admin-bar-expiring.png
Call log:
- Expect "toHaveScreenshot(admin-bar-expiring.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 5475 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 5475 pixels (ratio 0.14 of all image pixels) are different.
252 | // maxDiffPixels: 200 β tolerate timer-node width variation at mask boundary (same
253 | // rationale as VISN-03: .ab-label mask bounding box shifts slightly between runs).
> 254 | await expect( page ).toHaveScreenshot(
| ^
255 | 'admin-bar-expiring.png',
256 | {
257 | clip: { x: 0, y: 0, width: 1280, height: 32 },
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:254:30
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L190
3) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline
Retry #2 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: expect(page).toHaveScreenshot(expected) failed
5443 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: admin-bar-active.png
Call log:
- Expect "toHaveScreenshot(admin-bar-active.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 5443 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 5443 pixels (ratio 0.14 of all image pixels) are different.
188 | // 200px is above the observed max drift (64px) and well below any real regression.
189 | // This baseline primarily asserts: WP Sudo node is visible with green background.
> 190 | await expect( page ).toHaveScreenshot(
| ^
191 | 'admin-bar-active.png',
192 | {
193 | clip: { x: 0, y: 0, width: 1280, height: 32 },
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:190:30
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L190
3) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: expect(page).toHaveScreenshot(expected) failed
5443 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: admin-bar-active.png
Call log:
- Expect "toHaveScreenshot(admin-bar-active.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 5443 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 5443 pixels (ratio 0.14 of all image pixels) are different.
188 | // 200px is above the observed max drift (64px) and well below any real regression.
189 | // This baseline primarily asserts: WP Sudo node is visible with green background.
> 190 | await expect( page ).toHaveScreenshot(
| ^
191 | 'admin-bar-active.png',
192 | {
193 | clip: { x: 0, y: 0, width: 1280, height: 32 },
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:190:30
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L190
3) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline
Error: expect(page).toHaveScreenshot(expected) failed
5443 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: admin-bar-active.png
Call log:
- Expect "toHaveScreenshot(admin-bar-active.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 5443 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 5443 pixels (ratio 0.14 of all image pixels) are different.
188 | // 200px is above the observed max drift (64px) and well below any real regression.
189 | // This baseline primarily asserts: WP Sudo node is visible with green background.
> 190 | await expect( page ).toHaveScreenshot(
| ^
191 | 'admin-bar-active.png',
192 | {
193 | clip: { x: 0, y: 0, width: 1280, height: 32 },
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:190:30
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L125
2) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline
Retry #2 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('.wrap')
Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: settings-form.png
Call log:
- Expect "toHaveScreenshot(settings-form.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.wrap')
- locator resolved to <div class="wrap">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.wrap')
- locator resolved to <div class="wrap">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
123 | const muStatus = page.locator( '#wp-sudo-mu-status' );
124 |
> 125 | await expect( page.locator( '.wrap' ) ).toHaveScreenshot(
| ^
126 | 'settings-form.png',
127 | {
128 | threshold: 0.05,
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:125:49
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L125
2) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('.wrap')
Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: settings-form.png
Call log:
- Expect "toHaveScreenshot(settings-form.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.wrap')
- locator resolved to <div class="wrap">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.wrap')
- locator resolved to <div class="wrap">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
123 | const muStatus = page.locator( '#wp-sudo-mu-status' );
124 |
> 125 | await expect( page.locator( '.wrap' ) ).toHaveScreenshot(
| ^
126 | 'settings-form.png',
127 | {
128 | threshold: 0.05,
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:125:49
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L125
2) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('.wrap')
Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
Snapshot: settings-form.png
Call log:
- Expect "toHaveScreenshot(settings-form.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.wrap')
- locator resolved to <div class="wrap">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.wrap')
- locator resolved to <div class="wrap">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1078px by 2182px, received 1078px by 1421px. 312997 pixels (ratio 0.14 of all image pixels) are different.
123 | const muStatus = page.locator( '#wp-sudo-mu-status' );
124 |
> 125 | await expect( page.locator( '.wrap' ) ).toHaveScreenshot(
| ^
126 | 'settings-form.png',
127 | {
128 | threshold: 0.05,
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:125:49
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L93
1) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline
Retry #2 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('#wp-sudo-challenge-card')
Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: challenge-card.png
Call log:
- Expect "toHaveScreenshot(challenge-card.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#wp-sudo-challenge-card')
- locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#wp-sudo-challenge-card')
- locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
91 | await expect( card ).toBeVisible();
92 |
> 93 | await expect( card ).toHaveScreenshot( 'challenge-card.png', {
| ^
94 | threshold: 0.05,
95 | // maxDiffPixels not set β use threshold percentage for element clips
96 | } );
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:93:30
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L93
1) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('#wp-sudo-challenge-card')
Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: challenge-card.png
Call log:
- Expect "toHaveScreenshot(challenge-card.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#wp-sudo-challenge-card')
- locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#wp-sudo-challenge-card')
- locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
91 | await expect( card ).toBeVisible();
92 |
> 93 | await expect( card ).toHaveScreenshot( 'challenge-card.png', {
| ^
94 | threshold: 0.05,
95 | // maxDiffPixels not set β use threshold percentage for element clips
96 | } );
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:93:30
|
|
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline:
tests/e2e/specs/visual/regression-baselines.spec.ts#L93
1) [chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('#wp-sudo-challenge-card')
Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: challenge-card.png
Call log:
- Expect "toHaveScreenshot(challenge-card.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#wp-sudo-challenge-card')
- locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#wp-sudo-challenge-card')
- locator resolved to <div id="wp-sudo-challenge-card" class="wp-sudo-challenge-card">β¦</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 470px by 375px, received 470px by 367px. 9854 pixels (ratio 0.06 of all image pixels) are different.
91 | await expect( card ).toBeVisible();
92 |
> 93 | await expect( card ).toHaveScreenshot( 'challenge-card.png', {
| ^
94 | threshold: 0.05,
95 | // maxDiffPixels not set β use threshold percentage for element clips
96 | } );
at /home/runner/work/Sudo/Sudo/tests/e2e/specs/visual/regression-baselines.spec.ts:93:30
|
|
π Playwright Run Summary
4 failed
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:77:9 βΊ Visual regression baselines βΊ VISN-01: challenge page card element baseline
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:112:9 βΊ Visual regression baselines βΊ VISN-02: settings page form element baseline
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:159:9 βΊ Visual regression baselines βΊ VISN-03: admin bar node in active session state baseline
[chromium-visual] βΊ tests/e2e/specs/visual/regression-baselines.spec.ts:222:9 βΊ Visual regression baselines βΊ VISN-04: admin bar node in expiring state baseline
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
playwright-visual-report
|
49.5 MB |
sha256:03a8e7f718b8dc1d8034e2be5f4abfce8e3431c8a47e9ca32329464e9bed1281
|
|