Hi folks,
My name is Andrey, I'm a former Microsoft Playwright engineer. I'm leading the Flakiness.io project now.
I've noticed you're using Playwright Test and Vitest extensively. You even shard Playwright Tests. You might find Flakiness.io interesting since it'll give you a single place to see all your tests across frameworks and your commits history.
In addition to this, there are a few nice features that can simplify/optimize your setup:
- shard balancing minimizes the makespan of your sharded runs, so you'll get results faster. Your shards are pretty balanced, but I'd still be curious to see how it works on your workload.
- Sharded results are auto-merged and stored on the server together with their artifacts, so you don't need to run
merge-reports and download the playwright-html later to inspect results.
- Pull Requests and commits get Flakiness.io summary checks on GitHub
There's a free plan for open source projects.
Let me know if you're interested - I'd be happy to answer questions and get your feedback.
Thanks!
Andrey

Hi folks,
My name is Andrey, I'm a former Microsoft Playwright engineer. I'm leading the Flakiness.io project now.
I've noticed you're using Playwright Test and Vitest extensively. You even shard Playwright Tests. You might find Flakiness.io interesting since it'll give you a single place to see all your tests across frameworks and your commits history.
In addition to this, there are a few nice features that can simplify/optimize your setup:
merge-reportsand download the playwright-html later to inspect results.There's a free plan for open source projects.
Let me know if you're interested - I'd be happy to answer questions and get your feedback.
Thanks!
Andrey