Skip to content

parallel/test-runner-plan is flaky #57928

Open
@joyeecheung

Description

@joyeecheung

Test

test-runner-plan

Platform

Windows x64

Reason parallel/test-runner-plan
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/57866/, https://github.com/nodejs/node/pull/57438/, https://github.com/nodejs/node/pull/55337/, https://github.com/nodejs/node/pull/57871/, https://github.com/nodejs/node/pull/57879/)
Appeared test-azure_msft-win2016_vs2017-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/66243/
Last CI https://ci.nodejs.org/job/node-test-pull-request/66270/

Console output

Example

not ok 713 parallel/test-runner-plan
  ---
  duration_ms: 2169.01200
  severity: fail
  exitcode: 1
  stack: |-
    Test failure: 'throws if options is not an object'
    Location: test\parallel\test-runner-plan.mjs:9:3
    AssertionError [ERR_ASSERTION]: Missing expected exception.
        at assert.<computed> [as throws] (node:internal/test_runner/test:254:18)
        at TestContext.<anonymous> (file:///C:/workspace/node-test-binary-windows-js-suites/node/test/parallel/test-runner-plan.mjs:10:14)
        at Test.runInAsyncScope (node:async_hooks:214:14)
        at Test.run (node:internal/test_runner/test:979:25)
        at Test.start (node:internal/test_runner/test:877:17)
        at node:internal/test_runner/test:1356:71
        at node:internal/per_context/primordials:483:82
        at new Promise (<anonymous>)
        at new SafePromise (node:internal/per_context/primordials:451:29)
        at node:internal/per_context/primordials:483:9 {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      ...

Additional information

From the reliability reports, this seems to be x64 Windows only.

First report where it failed 3 PRs out of the last 100 CI runs: https://github.com/nodejs/reliability/blob/main/reports/2025-04-05.md
Latest report (today) where it failed 5 PRs out of the last 100 CI runs: https://github.com/nodejs/reliability/blob/main/reports/2025-04-18.md

The test was introduced in #57304

Metadata

Metadata

Assignees

No one assigned

    Labels

    flaky-testIssues and PRs related to the tests with unstable failures on the CI.test_runnerIssues and PRs related to the test runner subsystem.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions