This repository was archived by the owner on Aug 1, 2025. It is now read-only.
e2e-flakiness-detector #500
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention
Annotations
12 errors, 2 warnings, and 2 notices
|
command-edit.test.ts:33:3 › edit (fixup) task:
vscode\test\e2e\command-edit.test.ts#L104
6) command-edit.test.ts:33:3 › edit (fixup) task ─────────────────────────────────────────────────
Error: expect(locator).not.toBeVisible()
Locator: getByText('appleName')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for getByText('appleName')
- locator resolved to <span class="monaco-highlighted-label">appleName</span>
- unexpected value "visible"
- locator resolved to <span class="monaco-highlighted-label">appleName</span>
- unexpected value "visible"
- locator resolved to <span class="monaco-highlighted-label">appleName</span>
- unexpected value "visible"
102 | await page.keyboard.press('Enter')
103 | await nap()
> 104 | await expect(page.getByText('appleName')).not.toBeVisible()
| ^
105 | await expect(page.getByText('bananaName')).toBeVisible()
106 |
107 | // Accept: remove all the changes made by edit
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:104:51
|
|
command-edit.test.ts:33:3 › edit (fixup) task:
vscode\test\e2e\command-edit.test.ts#L53
6) command-edit.test.ts:33:3 › edit (fixup) task ─────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
51 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
52 | await nap()
> 53 | expect(modelItem).toBeVisible()
| ^
54 |
55 | // Open the model input and check it has the correct item selected
56 | await modelItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:53:23
|
|
command-edit.test.ts:121:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L144
5) command-edit.test.ts:121:1 › edit (fixup) input - range selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('check file-code Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('check file-code Nearest Code Block')
142 | await rangeItem.click()
143 | const selectedRangeItem = page.getByLabel('check file-code Nearest Code Block')
> 144 | expect(selectedRangeItem).toBeVisible()
| ^
145 |
146 | // Open the symbols input and check it has the correct item selected
147 | const symbolitem = page.getByText('Select a Symbol...')
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:144:31
|
|
command-commit.test.ts:23:3 › use terminal output as context:
vscode\test\e2e\helpers.ts#L407
4) command-commit.test.ts:23:3 › use terminal output as context ──────────────────────────────────
Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceiZK04p after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceiZK04p\logs\20250722T141933\window1\exthost\exthost.log'
at helpers.ts:407
405 | } catch (error) {
406 | if (attempts === 1) {
> 407 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`)
| ^
408 | }
409 |
410 | await new Promise(resolve => setTimeout(resolve, 100))
at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:407:23)
at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:288:13)
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L218
3) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Claude 3 Haiku' })
216 | await modelSelect.click()
217 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' })
> 218 | await modelChoices.getByRole('option', { name: 'Claude 3 Haiku' }).click()
| ^
219 | const lastChatInput = getChatInputs(chatFrame).last()
220 | await expect(lastChatInput).toBeFocused()
221 | await expect(modelSelect).toHaveText(/^Claude 3 Haiku/)
at D:\a\cody\cody\vscode\test\e2e\chat-input.test.ts:218:72
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
3) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L218
2) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Claude 3 Haiku' })
216 | await modelSelect.click()
217 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' })
> 218 | await modelChoices.getByRole('option', { name: 'Claude 3 Haiku' }).click()
| ^
219 | const lastChatInput = getChatInputs(chatFrame).last()
220 | await expect(lastChatInput).toBeFocused()
221 | await expect(modelSelect).toHaveText(/^Claude 3 Haiku/)
at D:\a\cody\cody\vscode\test\e2e\chat-input.test.ts:218:72
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
2) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_model_selector\temp-videos\0da8821a566247ed2829a13125d65ce6.webm' -> 'D:\a\cody\cody\playwright\chat_model_selector\videos\run_2_retry_0_failure.webm'
|
|
chat-input.test.ts:198:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L0
2) chat-input.test.ts:198:3 › chat model selector ────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
chat-atFile.test.ts:278:3 › @-mention file range:
vscode\test\e2e\helpers.ts#L407
1) chat-atFile.test.ts:278:3 › @-mention file range ──────────────────────────────────────────────
Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceEukMIl after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceEukMIl\Crashpad\reports\07f141d6-564a-4057-9bbf-54618a3bc2d8.dmp'
at helpers.ts:407
405 | } catch (error) {
406 | if (attempts === 1) {
> 407 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`)
| ^
408 | }
409 |
410 | await new Promise(resolve => setTimeout(resolve, 100))
at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:407:23)
at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:288:13)
|
|
test-e2e (ubuntu)
Process completed with exit code 1.
|
|
command-custom.test.ts:45:3 › create a new user command via the custom commands menu:
vscode/test/e2e/command-custom.test.ts#L92
1) command-custom.test.ts:45:3 › create a new user command via the custom commands menu ──────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('New Custom Cody Command: Prompt')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('New Custom Cody Command: Prompt')
90 | // Enter prompt
91 | const promptInputTitle = page.getByText('New Custom Cody Command: Prompt')
> 92 | await expect(promptInputTitle).toBeVisible()
| ^
93 | const promptInputBox = page.getByPlaceholder(
94 | 'e.g. Create five different test cases for the selected code'
95 | )
at /home/runner/work/cody/cody/vscode/test/e2e/command-custom.test.ts:92:36
|
|
test-e2e (windows)
The process 'C:\Program Files\Git\bin\git.exe' failed with exit code 128
|
|
test-e2e (ubuntu)
The process '/usr/bin/git' failed with exit code 128
|
|
🎭 Playwright Run Summary
8 failed
chat-atFile.test.ts:278:3 › @-mention file range ───────────────────────────────────────────────
chat-input.test.ts:198:3 › chat model selector ─────────────────────────────────────────────────
chat-input.test.ts:198:3 › chat model selector ─────────────────────────────────────────────────
command-commit.test.ts:23:3 › use terminal output as context ───────────────────────────────────
command-edit.test.ts:121:1 › edit (fixup) input - range selection ──────────────────────────────
command-edit.test.ts:33:3 › edit (fixup) task ──────────────────────────────────────────────────
command-edit.test.ts:121:1 › edit (fixup) input - range selection ──────────────────────────────
command-edit.test.ts:33:3 › edit (fixup) task ──────────────────────────────────────────────────
60 skipped
156 passed (52.1m)
|
|
🎭 Playwright Run Summary
1 failed
command-custom.test.ts:45:3 › create a new user command via the custom commands menu ───────────
150 skipped
409 passed (1.8h)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
playwright-recordings ubuntu
Expired
|
723 KB |
sha256:aa02f12e1e7dfdfc335e2056a952b3daecb94a384bc78184a0974444efe052bd
|
|
|
playwright-recordings windows
Expired
|
1.44 MB |
sha256:85e18e3e1256165aebedad96a95c63a4dacd2e8dcfc9286ec4b90e1e992063de
|
|