Skip to content
This repository was archived by the owner on Aug 1, 2025. It is now read-only.

e2e-flakiness-detector #490

e2e-flakiness-detector

e2e-flakiness-detector #490

Triggered via schedule July 12, 2025 14:05
Status Failure
Total duration 1h 48m 57s
Artifacts 1
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 2 warnings, and 2 notices
command-edit.test.ts:33:3 › edit (fixup) task: vscode\test\e2e\command-edit.test.ts#L53
6) command-edit.test.ts:33:3 › edit (fixup) task ───────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" 51 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') 52 | await nap() > 53 | expect(modelItem).toBeVisible() | ^ 54 | 55 | // Open the model input and check it has the correct item selected 56 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:53:23
command-custom.test.ts:45:3 › create a new user command via the custom commands menu: vscode\test\e2e\command-custom.test.ts#L92
5) command-custom.test.ts:45:3 › create a new user command via the custom commands menu ────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('New Custom Cody Command: Prompt') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('New Custom Cody Command: Prompt') 90 | // Enter prompt 91 | const promptInputTitle = page.getByText('New Custom Cody Command: Prompt') > 92 | await expect(promptInputTitle).toBeVisible() | ^ 93 | const promptInputBox = page.getByPlaceholder( 94 | 'e.g. Create five different test cases for the selected code' 95 | ) at D:\a\cody\cody\vscode\test\e2e\command-custom.test.ts:92:36
command-custom.test.ts:45:3 › create a new user command via the custom commands menu: vscode\test\e2e\command-custom.test.ts#L0
4) command-custom.test.ts:45:3 › create a new user command via the custom commands menu ────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\create_a_new_user_command_via_the_custom_commands_menu\temp-videos\8e791512f84f74ca5a12f628eccb7014.webm' -> 'D:\a\cody\cody\playwright\create_a_new_user_command_via_the_custom_commands_menu\videos\run_1_retry_0_failure.webm'
command-custom.test.ts:45:3 › create a new user command via the custom commands menu: vscode\test\e2e\command-custom.test.ts#L92
4) command-custom.test.ts:45:3 › create a new user command via the custom commands menu ────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('New Custom Cody Command: Prompt') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('New Custom Cody Command: Prompt') 90 | // Enter prompt 91 | const promptInputTitle = page.getByText('New Custom Cody Command: Prompt') > 92 | await expect(promptInputTitle).toBeVisible() | ^ 93 | const promptInputBox = page.getByPlaceholder( 94 | 'e.g. Create five different test cases for the selected code' 95 | ) at D:\a\cody\cody\vscode\test\e2e\command-custom.test.ts:92:36
command-commit.test.ts:23:3 › use terminal output as context: vscode\test\e2e\helpers.ts#L407
3) command-commit.test.ts:23:3 › use terminal output as context ────────────────────────────────── Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceFz0eiQ after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceFz0eiQ\logs\20250712T141730\window1\exthost\exthost.log' at helpers.ts:407 405 | } catch (error) { 406 | if (attempts === 1) { > 407 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`) | ^ 408 | } 409 | 410 | await new Promise(resolve => setTimeout(resolve, 100)) at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:407:23) at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:288:13)
chat-input.test.ts:31:3 › chat input focus: vscode\test\e2e\chat-input.test.ts#L0
2) chat-input.test.ts:31:3 › chat input focus ──────────────────────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_input_focus\temp-videos\005cde6289b54e1a90468e21cf48b2a8.webm' -> 'D:\a\cody\cody\playwright\chat_input_focus\videos\run_2_retry_0_failure.webm'
chat-input.test.ts:31:3 › chat input focus: vscode\test\e2e\chat-input.test.ts#L80
2) chat-input.test.ts:31:3 › chat input focus ──────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeFocused() Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last() Expected: focused Received: inactive Call log: - expect.toBeFocused with timeout 5000ms - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last() - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" - locator resolved to <div role="textbox" spellcheck="true" contenteditable="true" aria-label="Chat message" data-lexical-editor="true" class="_content-editable_s4gjm_6 _editor-content-editable_1eiqs_30">…</div> - unexpected value "not focused" 78 | await firstChatInput.press('Enter') 79 | await page.waitForTimeout(400) > 80 | await expect(lastChatInput).toBeFocused() | ^ 81 | 82 | // Make sure the chat input box does not steal focus from the editor when editor 83 | // is focused. at D:\a\cody\cody\vscode\test\e2e\chat-input.test.ts:80:33
chat-atFile.test.ts:316:3 › @-mention symbol in chat: vscode\test\e2e\common.ts#L180
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Symbols' }) at common.ts:180 178 | ): Promise<void> { 179 | await chatInput.pressSequentially('@', { delay: 350 }) > 180 | await frame.getByRole('option', { name: provider, exact }).click() | ^ 181 | } 182 | 183 | export function mentionMenu(chatFrame: FrameLocator): Locator { at openMentionsForProvider (D:\a\cody\cody\vscode\test\e2e\common.ts:180:64) at D:\a\cody\cody\vscode\test\e2e\chat-atFile.test.ts:347:5
chat-atFile.test.ts:316:3 › @-mention symbol in chat: vscode\test\e2e\chat-atFile.test.ts#L0
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ────────────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\__mention_symbol_in_chat\temp-videos\00ac87027a2dd1321fe1356b2aeb8ea5.webm' -> 'D:\a\cody\cody\playwright\__mention_symbol_in_chat\videos\run_0_retry_0_failure.webm'
chat-atFile.test.ts:316:3 › @-mention symbol in chat: vscode\test\e2e\chat-atFile.test.ts#L0
1) chat-atFile.test.ts:316:3 › @-mention symbol in chat ────────────────────────────────────────── Test timeout of 30000ms exceeded.
test-e2e (windows)
The process 'C:\Program Files\Git\bin\git.exe' failed with exit code 128
test-e2e (ubuntu)
The process '/usr/bin/git' failed with exit code 128
🎭 Playwright Run Summary
9 failed chat-atFile.test.ts:316:3 › @-mention symbol in chat ─────────────────────────────────────────── chat-input.test.ts:31:3 › chat input focus ───────────────────────────────────────────────────── command-commit.test.ts:23:3 › use terminal output as context ─────────────────────────────────── command-custom.test.ts:45:3 › create a new user command via the custom commands menu ─────────── command-custom.test.ts:45:3 › create a new user command via the custom commands menu ─────────── command-edit.test.ts:33:3 › edit (fixup) task ────────────────────────────────────────────────── command-edit.test.ts:121:1 › edit (fixup) input - range selection ────────────────────────────── command-edit.test.ts:33:3 › edit (fixup) task ────────────────────────────────────────────────── command-edit.test.ts:121:1 › edit (fixup) input - range selection ────────────────────────────── 60 skipped 155 passed (50.8m)
🎭 Playwright Run Summary
150 skipped 410 passed (1.8h)

Artifacts

Produced during runtime
Name Size Digest
playwright-recordings windows Expired
1.67 MB
sha256:11e6c1c756310d8d289c670559989aa1ee46c163c0a86e930a3836422265a35b