cucumber.js + playwright + allure shows N-1 tests in a report

[vlevkoniuk]

For a long time, I have been facing the issue that allure report shows N-1 tests in a report (e.g. 99 out of 100), the last test case is lost somehow
At the same time, all other available reports show ok, xml and json files contain the data for all tests

Asked AI about that, it suggested that because allure writes files asynchronously, it may need more time to flush, but adding timeouts after all tests will not help

The test case that is lost is not the last test case. It is somewhere in the middle of the test run

I am using azure devops and one of the extensions in the marketplace to build and show a report

To Reproduce
Steps to reproduce the behavior:
Complete a lot of test cases and generate a report

Expected behavior
all test cases are shown

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: Windows 11
• Node 22, 24, Cucumber.js v12.x, allure-cucumberjs 3.4.1
• tests are running in Azure DevOps agents

Additional context
generating reports locally produces the same results, so the configuration of the plugin should be ok

I have the following format configuration in cucumber config
format: [
...common.format,
"allure-cucumberjs/reporter:allure",
'json:./reports/cucumber.json',
'html:./reports/cucumber-embedded.html',
'junit:./reports/cucumber.xml'
],
formatOptions: {
...common.formatOptions,
resultsDir: "allure-results"
},

[clergyman]

Hello @vlevkoniuk , thank you so much for flagging this. Could you please add an example of a repo with working code, or an archive of allure-results folder, since you've stated that the result.json files are all in place, maybe something has gone astray with the rendering part. This would help us a lot to dive into the issue.

[vlevkoniuk]

@clergyman
I can't share results because they contain non-public data
But after deeper investigation, I found that I had 1 test with the same name as another test within 1 feature file, but with different steps. All reports were handling it correctly, only allure was thinking it was 1 test, as a result, it showed N-1 tests in total