Skip to content

wpt run should be able to run only tests in Interop #48603

Open
@gsnedders

Description

@gsnedders

We should add a number of command line arguments to wpt run to make it possible to select the subset of tests in Interop.

There's a few potential variants here:

  • Running tests with a given label,
  • Running tests in a given Interop category (which is formed of a number of labels),
  • Running all tests in Interop 20xx.

The data is basically split between https://github.com/web-platform-tests/results-analysis/blob/main/interop-scoring/category-data.json and https://github.com/web-platform-tests/wpt.fyi/blob/main/webapp/static/interop-data.json, and we can get all the labels from https://wpt.fyi/api/metadata?includeTestLevel=true&product=chrome rather than manually re-parsing all of https://github.com/web-platform-tests/wpt-metadata.

(Arguably this can already be done by writing a script to enumerate all the tests in one of those variants and put them in a file and then just run with --include-file, but it would be easier to just have this all integrated into wpt run.)

Metadata

Metadata

Assignees

No one assigned

    Labels

    wptrunnerThe automated test runner, commonly called through ./wpt run

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions