Skip to content

devops: split test runner tests and core tests into seperate workflows#39760

Open
dgozman wants to merge 1 commit intomicrosoft:mainfrom
dgozman:devops-test-test-runner
Open

devops: split test runner tests and core tests into seperate workflows#39760
dgozman wants to merge 1 commit intomicrosoft:mainfrom
dgozman:devops-test-test-runner

Conversation

@dgozman
Copy link
Copy Markdown
Collaborator

@dgozman dgozman commented Mar 19, 2026

No description provided.

@yury-s yury-s requested a review from Copilot March 19, 2026 05:32
- 'packages/playwright-core/src/server/bidi/**'
- 'packages/playwright-core/src/tools/**'
- 'tests/bidi/**'
- 'packages/playwright/**'
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

library tests depend on expect

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR splits Playwright’s GitHub Actions CI so test-runner-related checks run in a dedicated workflow, while the primary “core” test workflow no longer runs for packages/playwright/**-only changes.

Changes:

  • Introduces a new test runner workflow to run the test runner suite (ttest) and VSCode extension tests.
  • Updates tests_primary.yml to ignore packages/playwright/** changes and removes the test-runner/VSCode-extension jobs from it.
  • Updates create_test_report.yml to include the new test runner workflow as an input to report publishing.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File Description
.github/workflows/tests_test_runner.yml New workflow for test runner + VSCode extension testing.
.github/workflows/tests_primary.yml Stops running primary tests on packages/playwright/**-only PR changes; removes migrated jobs.
.github/workflows/create_test_report.yml Adds test runner to the list of workflows whose results are merged/published.

@github-actions
Copy link
Copy Markdown
Contributor

Test results for "tests 1"

6 flaky ⚠️ [chromium-library] › library/trace-viewer.spec.ts:1223 › should display language-specific locators `@ubuntu-22.04-chromium-tip-of-tree`
⚠️ [chromium-library] › library/popup.spec.ts:261 › should not throw when click closes popup `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/popup.spec.ts:261 › should not throw when click closes popup `@chromium-ubuntu-22.04-node20`
⚠️ [chromium-page] › page/page-request-continue.spec.ts:754 › propagate headers cross origin redirect after interception `@chromium-ubuntu-22.04-node20`
⚠️ [firefox-page] › page/retarget.spec.ts:337 › check retargeting `@firefox-ubuntu-22.04-node20`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:758 › run-server › should upload a folder `@webkit-ubuntu-22.04-node20`

29452 passed, 730 skipped


Merge workflow run.

@github-actions
Copy link
Copy Markdown
Contributor

Test results for "MCP"

5507 passed, 343 skipped


Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants