Description
We should add a number of command line arguments to wpt run
to make it possible to select the subset of tests in Interop.
There's a few potential variants here:
- Running tests with a given label,
- Running tests in a given Interop category (which is formed of a number of labels),
- Running all tests in Interop 20xx.
The data is basically split between https://github.com/web-platform-tests/results-analysis/blob/main/interop-scoring/category-data.json and https://github.com/web-platform-tests/wpt.fyi/blob/main/webapp/static/interop-data.json, and we can get all the labels from https://wpt.fyi/api/metadata?includeTestLevel=true&product=chrome rather than manually re-parsing all of https://github.com/web-platform-tests/wpt-metadata.
(Arguably this can already be done by writing a script to enumerate all the tests in one of those variants and put them in a file and then just run with --include-file
, but it would be easier to just have this all integrated into wpt run.)