Skip to content

Tests from different packages might be treated as retries of each other #1323

@delatrie

Description

@delatrie

Describe the bug

Different tests get the same fullName, titlePath, testCaseId, and historyId if:

  • They are from different packages (e.g., in a multirepo).
  • And they have the same file path and suite names.

Allure Report (both v2 and v3) will display only one such test, hiding the others behind the "Retries" tab.

To Reproduce

Since the issue affects the allure-js repo, the easiest way to reproduce it is as follows:

  1. Clone this repo, checkout tags/v.3.2.2, install deps, and build the code.
  2. yarn workspaces foreach -Avvt run vitest run ./test/spec/globalLabels.test.ts -t "^should handle global labels$" --passWithNoTests.
  3. allure serve $(find ./packages/allure-*/out/allure-results -type d) (for Windows, allure serve @(gi ./packages/allure-*/out/allure-results/)).
  4. See the error: only one test is displayed in the trees. Other tests are hidden as the test's retries, rather than being separate tests.

Expected behavior
Tests of different packages must be treated as separate tests in all cases.

Screenshots

Image Image Image

Additional context

We normalize fullNames relative to the package.json, which means we can read the package's name from it in most cases.

Metadata

Metadata

Assignees

Labels

theme:apiJavascript API related issuetype:bugSomething isn't working

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions