Skip to content
This repository was archived by the owner on Aug 1, 2025. It is now read-only.

e2e-flakiness-detector #498

e2e-flakiness-detector

e2e-flakiness-detector #498

Triggered via schedule July 20, 2025 14:04
Status Failure
Total duration 1h 53m 34s
Artifacts 2
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

12 errors, 2 warnings, and 2 notices
command-core.test.ts:69:3 › Document Command (Edit): vscode\test\e2e\helpers.ts#L407
5) command-core.test.ts:69:3 › Document Command (Edit) ─────────────────────────────────────────── Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsce9OggQ1 after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsce9OggQ1\Crashpad\reports\9252ca94-d7f8-43b6-9230-6a77afc0fc0a.dmp' at helpers.ts:407 405 | } catch (error) { 406 | if (attempts === 1) { > 407 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`) | ^ 408 | } 409 | 410 | await new Promise(resolve => setTimeout(resolve, 100)) at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:407:23) at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:288:13)
command-commit.test.ts:23:3 › use terminal output as context: vscode\test\e2e\command-commit.test.ts#L0
4) command-commit.test.ts:23:3 › use terminal output as context ────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\use_terminal_output_as_context\temp-videos\4fc33791f063a0e008d1210996adf03c.webm' -> 'D:\a\cody\cody\playwright\use_terminal_output_as_context\videos\run_0_retry_0_failure.webm'
command-commit.test.ts:23:3 › use terminal output as context: vscode\test\e2e\command-commit.test.ts#L44
4) command-commit.test.ts:23:3 › use terminal output as context ────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByLabel('Source Control Input').filter({ hasText: 'hello from the assistant' }).first() Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('Source Control Input').filter({ hasText: 'hello from the assistant' }).first() 42 | 43 | const scmInputBox = page.getByLabel('Source Control Input') > 44 | await expect(scmInputBox.filter({ hasText: 'hello from the assistant' }).first()).toBeVisible() | ^ 45 | 46 | // Ensure that no notification is shown 47 | await expect(page.getByLabel('Cody was forced to skip').first()).not.toBeVisible({ at D:\a\cody\cody\vscode\test\e2e\command-commit.test.ts:44:87
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L216
3) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last() - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rf:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not stable - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header c
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
3) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Test timeout of 30000ms exceeded.
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L216
2) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last() - locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rf:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button> - attempting click action - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
2) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Test timeout of 30000ms exceeded.
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L218
1) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Claude 3 Haiku' }) 216 | await modelSelect.click() 217 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' }) > 218 | await modelChoices.getByRole('option', { name: 'Claude 3 Haiku' }).click() | ^ 219 | const lastChatInput = getChatInputs(chatFrame).last() 220 | await expect(lastChatInput).toBeFocused() 221 | await expect(modelSelect).toHaveText(/^Claude 3 Haiku/) at D:\a\cody\cody\vscode\test\e2e\chat-input.test.ts:218:72
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
1) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\chat_model_selector\temp-videos\caa1433e20dea0cd999831e5ed3b4586.webm' -> 'D:\a\cody\cody\playwright\chat_model_selector\videos\run_0_retry_0_failure.webm'
chat-input.test.ts:198:3 › chat model selector: vscode\test\e2e\chat-input.test.ts#L0
1) chat-input.test.ts:198:3 › chat model selector ──────────────────────────────────────────────── Test timeout of 30000ms exceeded.
test-e2e (ubuntu)
Process completed with exit code 1.
command-custom.test.ts:45:3 › create a new user command via the custom commands menu: vscode/test/e2e/command-custom.test.ts#L92
1) command-custom.test.ts:45:3 › create a new user command via the custom commands menu ────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('New Custom Cody Command: Prompt') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('New Custom Cody Command: Prompt') 90 | // Enter prompt 91 | const promptInputTitle = page.getByText('New Custom Cody Command: Prompt') > 92 | await expect(promptInputTitle).toBeVisible() | ^ 93 | const promptInputBox = page.getByPlaceholder( 94 | 'e.g. Create five different test cases for the selected code' 95 | ) at /home/runner/work/cody/cody/vscode/test/e2e/command-custom.test.ts:92:36
test-e2e (windows)
The process 'C:\Program Files\Git\bin\git.exe' failed with exit code 128
test-e2e (ubuntu)
The process '/usr/bin/git' failed with exit code 128
🎭 Playwright Run Summary
10 failed chat-input.test.ts:198:3 › chat model selector ───────────────────────────────────────────────── chat-input.test.ts:198:3 › chat model selector ───────────────────────────────────────────────── chat-input.test.ts:198:3 › chat model selector ───────────────────────────────────────────────── command-commit.test.ts:23:3 › use terminal output as context ─────────────────────────────────── command-core.test.ts:69:3 › Document Command (Edit) ──────────────────────────────────────────── command-custom.test.ts:280:17 › use terminal output as context ───────────────────────────────── command-edit.test.ts:121:1 › edit (fixup) input - range selection ────────────────────────────── command-edit.test.ts:33:3 › edit (fixup) task ────────────────────────────────────────────────── command-edit.test.ts:121:1 › edit (fixup) input - range selection ────────────────────────────── initial-context.test.ts:46:18 › initial context - file ───────────────────────────────────────── 60 skipped 154 passed (51.9m)
🎭 Playwright Run Summary
1 failed command-custom.test.ts:45:3 › create a new user command via the custom commands menu ─────────── 150 skipped 409 passed (1.8h)

Artifacts

Produced during runtime
Name Size Digest
playwright-recordings ubuntu Expired
700 KB
sha256:45c8f38086464263c4c7e515f9947be372ff9c2705ed19e72c7d455658a14d4d
playwright-recordings windows Expired
1.56 MB
sha256:dc7e68f061952190253fbc4cf136e1c84c6a02cd44da273ec4b5e2e43fd69d72