Skip to content

Conversation

@bgrgicak
Copy link
Owner

@bgrgicak bgrgicak commented Nov 7, 2025

Descriptions

This PR is a prototype of Playwright tests for the Playground tester and can be used as inspiration for adding E2E tests to the Playground tester in the future.

The code in this PR hasn't been cleaned up and it was used to generate one-time compatibility reports where we compared how Playground performed in November 2024 (commit e7c27ef09) compared to November 2025 (commit 5a0d79a).

Testing instructions

  • For this to work you need to run two versions of Playground, you can do this using git worktrees.
  • Run a old version of Playground by checking out a commit and running npx nx run playground-website:build:wasm-wordpress-net && npm run preview
  • Run the current version of Playground.
  • Checkout this branch
  • Setup the environment https://github.com/bgrgicak/playground-tester#installation
  • Setup Playwright npx playwright install --with-deps
  • Adjust the Playground URLs to match your preview site URLs in this configuration object
  • Run tests npx playwright test
  • After running all tests use ./scripts/update-error-stats-data.sh to parse Playwright reports
  • Generate a report page, run ./scripts/generate-reports.sh

Some plugins disable the activate button until the dependency is installed and active.
Some plugins don't have a Dactivate button with the #deactivate-SLUG ID.
- use cors proxy if plugin requires new version of wp
- use activate href to detect activate button
- wait for the activate button to appear
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants