Skip to content

Test runs used for scoring can sometimes revert to previous browser versions #188

Open
@DanielRyanSmith

Description

@DanielRyanSmith

On September 14th, a test run of Chrome ran with labels "master" and "stable" for Chrome version 116. This came after a Chrome 117 was used for a run with the same labels on September 12th.

https://wpt.fyi/results/?diff&filter=ADC&run_id=5096725200502784&run_id=5118043404894208

This instance of running Chrome 117 as stable and then reverting to 116 resulted in a jump in the Chrome interop score for stable, then reverted that score.
interop-graph

This is likely a transient issue, as subsequent runs of stable have so far been using Chrome 117. If this becomes problematic in further scoring, or additional runs continue to fluctuate between using different browser versions, further investigation and action may be necessary.

cc @nairnandu

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions