matrix-react-sdk End to End Tests #4948
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element-Web
1m 53s
Matrix: Playwright / playwright
Playwright
/
...
/
Run Playwright end-to-end tests & upload html report
3m 33s
Playwright
/
end-to-end-tests
34s
Annotations
5 errors and 6 notices
|
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts:89:13 › Read receipts › new messages › in threads › Reading an older thread message leaves the thread unread @mergequeue:
playwright/e2e/read-receipts/index.ts#L569
1) [Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts:89:13 › Read receipts › new messages › in threads › Reading an older thread message leaves the thread unread @mergequeue
Error: expect(locator).toBeVisible() failed
Locator: locator('.mx_ThreadPanel li').filter({ hasText: 'ThreadRoot' }).locator('.mx_NotificationBadge')
Expected: visible
Timeout: 5000ms
Error: element(s) not found
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for locator('.mx_ThreadPanel li').filter({ hasText: 'ThreadRoot' }).locator('.mx_NotificationBadge')
at read-receipts/index.ts:569
567 | async assertUnreadThread(rootMessage: string) {
568 | const tile = await this.getThreadListTile(rootMessage);
> 569 | await expect(tile.locator(".mx_NotificationBadge")).toBeVisible();
| ^
570 | }
571 |
572 | /**
at Helpers.assertUnreadThread (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:569:61)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/new-messages-in-threads.spec.ts:111:17
|
|
[Chrome] › playwright/e2e/app-loading/stored-credentials.spec.ts:26:1 › Shows the last known page on reload:
playwright/e2e/app-loading/stored-credentials.spec.ts#L42
2) [Chrome] › playwright/e2e/app-loading/stored-credentials.spec.ts:26:1 › Shows the last known page on reload
Error: expect(page).toHaveURL(expected) failed
Expected pattern: /\/#\/room\//
Received string: "http://localhost:8080/#/home"
Timeout: 5000ms
Call log:
- Expect "toHaveURL" with timeout 5000ms
9 × unexpected value "http://localhost:8080/#/home"
40 |
41 | // Check that the room reloaded
> 42 | await expect(page).toHaveURL(/\/#\/room\//);
| ^
43 | await expect(page.locator(".mx_RoomHeader")).toContainText("Test Room");
44 | });
45 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/app-loading/stored-credentials.spec.ts:42:24
|
|
[Chrome] › playwright/e2e/accessibility/keyboard-navigation.spec.ts:106:5 › Landmark navigation tests › without an open room:
playwright/e2e/accessibility/keyboard-navigation.spec.ts#L142
1) [Chrome] › playwright/e2e/accessibility/keyboard-navigation.spec.ts:106:5 › Landmark navigation tests › without an open room
Error: expect(locator).toBeFocused() failed
Locator: locator('.mx_HomePage')
Expected: focused
Received: inactive
Timeout: 5000ms
Call log:
- Expect "toBeFocused" with timeout 5000ms
- waiting for locator('.mx_HomePage')
7 × locator resolved to <main tabindex="-1" class="mx_AutoHideScrollbar mx_HomePage mx_HomePage_default">…</main>
- unexpected value "inactive"
140 | // Pressing Control+F6 again will focus the home section
141 | await page.keyboard.press("ControlOrMeta+F6");
> 142 | await expect(page.locator(".mx_HomePage")).toBeFocused();
| ^
143 |
144 | // Pressing Control+F6 will bring focus back to the space button
145 | await page.keyboard.press("ControlOrMeta+F6");
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/accessibility/keyboard-navigation.spec.ts:142:52
|
|
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot:
playwright/e2e/left-panel/room-list-panel/room-list.spec.ts#L336
1) [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: getByTestId('room-list').getByRole('option', { name: 'video room' })
400 pixels (ratio 0.03 of all image pixels) are different.
Snapshot: room-list-item-video.png
Call log:
- Expect "toHaveScreenshot(room-list-item-video.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('room-list').getByRole('option', { name: 'video room' })
- locator resolved to <button type="button" role="option" tabindex="-1" aria-setsize="1" aria-posinset="1" data-state="closed" aria-haspopup="menu" aria-selected="false" aria-label="Open room video room" class="_flex_4dswl_9 _roomListItem_1hafs_8 mx_RoomListItemView">…</button>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 400 pixels (ratio 0.03 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('room-list').getByRole('option', { name: 'video room' })
- locator resolved to <button type="button" role="option" tabindex="-1" aria-setsize="1" aria-posinset="1" data-state="closed" aria-haspopup="menu" aria-selected="false" aria-label="Open room video room" class="_flex_4dswl_9 _roomListItem_1hafs_8 mx_RoomListItemView">…</button>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 400 pixels (ratio 0.03 of all image pixels) are different.
334 |
335 | await expect(videoRoom).toBeVisible();
> 336 | await expect(videoRoom).toMatchScreenshot("room-list-item-video.png");
| ^
337 | });
338 | });
339 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:336:37
|
|
[Chrome] › playwright/e2e/widgets/permissions-dialog.spec.ts:49:5 › Widger permissions dialog › should be updated if user is re-invited into the room with updated state event @screenshot:
playwright/e2e/widgets/permissions-dialog.spec.ts#L92
1) [Chrome] › playwright/e2e/widgets/permissions-dialog.spec.ts:49:5 › Widger permissions dialog › should be updated if user is re-invited into the room with updated state event @screenshot
Error: expect(received).toEqual(expected) // deep equality
- Expected - 1
+ Received + 55
- Array []
+ Array [
+ Object {
+ "description": "Ensure interactive controls are not nested as they are not always announced by screen readers or can cause focus problems for assistive technologies",
+ "help": "Interactive controls must not be nested",
+ "helpUrl": "https://dequeuniversity.com/rules/axe/4.11/nested-interactive?application=playwright",
+ "id": "nested-interactive",
+ "impact": "serious",
+ "nodes": Array [
+ Object {
+ "all": Array [],
+ "any": Array [
+ Object {
+ "data": null,
+ "id": "no-focusable-content",
+ "impact": "serious",
+ "message": "Element has focusable descendants",
+ "relatedNodes": Array [
+ Object {
+ "html": "<button class=\"_icon-button_1215g_8\" role=\"button\" tabindex=\"0\" aria-disabled=\"false\" aria-label=\"More Options\" type=\"button\" id=\"radix-_r_1f_\" aria-haspopup=\"menu\" aria-expanded=\"false\" data-state=\"closed\" data-kind=\"primary\" aria-labelledby=\"_r_1h_\" style=\"--cpd-icon-button-si...\">",
+ "target": Array [
+ "#radix-_r_1f_",
+ ],
+ },
+ Object {
+ "html": "<button class=\"_icon-button_1215g_8\" role=\"button\" tabindex=\"0\" aria-disabled=\"false\" aria-label=\"Notification options\" type=\"button\" id=\"radix-_r_1m_\" aria-haspopup=\"menu\" aria-expanded=\"false\" data-state=\"closed\" data-kind=\"primary\" aria-labelledby=\"_r_1o_\" style=\"--cpd-icon-button-si...\">",
+ "target": Array [
+ "#radix-_r_1m_",
+ ],
+ },
+ ],
+ },
+ ],
+ "failureSummary": "Fix any of the following:
+ Element has focusable descendants",
+ "html": "<button type=\"button\" role=\"option\" aria-posinset=\"1\" aria-setsize=\"1\" aria-selected=\"true\" aria-label=\"Open room Demo\" tabindex=\"-1\" data-state=\"closed\" aria-haspopup=\"menu\" class=\"_flex_4dswl_9 _roomL...\" style=\"--mx-flex-display: f...\">",
+ "impact": "serious",
+ "none": Array [],
+ "target": Array [
+ "._roomListItem_1hafs_8",
+ ],
+ },
+ ],
+ "tags": Array [
+ "cat.keyboard",
+ "wcag2a",
+ "wcag412",
+ "TTv5",
+ "TT6.a",
+ "EN-301-549",
+ "EN-9.4.1.2",
+ "RGAAv4",
+ "RGAA-7.1.1",
+ ],
+ },
+ ]
90 |
91 | axe.disableRules("color-contrast"); // XXX: Inheriting colour contrast issues from room view.
> 92 | await expect(axe).toHaveNoViolations();
| ^
93 | await expect(page.locator(".mx_WidgetCapabilitiesPromptDialog")).toMatchScreenshot(
94 | "widget-capabilites-prompt.png",
95 | );
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/widgets/permissions-dialog.spec.ts:92:31
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts:89:13 › Read receipts › new messages › in threads › Reading an older thread message leaves the thread unread @mergequeue
44 skipped
58 passed (8.6m)
|
|
🎭 Playwright Run Summary
2 skipped
108 passed (9.7m)
|
|
🎭 Playwright Run Summary
3 skipped
105 passed (9.6m)
|
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › playwright/e2e/accessibility/keyboard-navigation.spec.ts:106:5 › Landmark navigation tests › without an open room
[Chrome] › playwright/e2e/app-loading/stored-credentials.spec.ts:26:1 › Shows the last known page on reload
107 passed (10.4m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:320:9 › Room list › Avatar decoration › should be a video room @screenshot
1 skipped
110 passed (11.2m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/widgets/permissions-dialog.spec.ts:49:5 › Widger permissions dialog › should be updated if user is re-invited into the room with updated state event @screenshot
105 passed (11.9m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
all-blob-reports-Chrome-1
Expired
|
7.03 MB |
sha256:fd389d398a3f19f2cf2a71e475cb69cc4d6979f4d56d88ee7347f651b1e2f618
|
|
|
all-blob-reports-Chrome-2
Expired
|
4.2 MB |
sha256:1b303e0939ed5d047b02dd4c395059031c450d112818d83ce513bb00995b1145
|
|
|
all-blob-reports-Chrome-3
Expired
|
5.93 MB |
sha256:74fa2811542c6b0c9cc702440353dd764272ea039aadb2bc8292161a73c8c93e
|
|
|
all-blob-reports-Chrome-4
Expired
|
494 KB |
sha256:fcac505dd0c75447e029c9cca01a1d1db81d29b692f987594c48c5c882d7907e
|
|
|
all-blob-reports-Chrome-5
Expired
|
823 KB |
sha256:780119770bef73a79de4854eb0d8553708a30bdf5373f10d0907c80021c98df4
|
|
|
all-blob-reports-Chrome-6
Expired
|
5.57 MB |
sha256:1babecf9ebec46f465586353f16613b8fb69d06eb43089edfb9bb7a5b259188e
|
|
|
html-report
|
23.2 MB |
sha256:e4d1abe2d33dd6b2e7de7a621bad104e2f85bcf28ab7c1146d715e696425d41d
|
|
|
playwright-html-report
|
292 KB |
sha256:0e24bc16b12dfe0d9463d8050c550da54e0cfc1444e0650490cb79e2397161dc
|
|
|
webapp
Expired
|
39.3 MB |
sha256:7b5f001ef5d32d7ea8e4a75886c537d82bf122d453c4fca658777ca13f2cabf6
|
|