Moving infrequently failing tests into the usual exclude files

[adamfarley]

This excludes any tests that could interrupt a release, and also helps keep our test runs green at the expense of nonblocker test executions. Plus it reduces complexity by reducing the number of exclude files, which makes maintenance easier.

Note 1: All "unreliable" tests excluded in this commit have been identified as not blocking a release (nonblocker) in at least one previous release cycle.

Note 2: The issues related to these infrequently failing tests will be updated to include a title change and an additional tag to indicate they they are infrequent failure.

@sophia-guo - Do you think this PR can go in in parallel to that work, or do you feel we should hold fire until the related issues are updated?

Progresses (but does not resolve) #6593

[smlambert]

I am looking at the issue links under which these exclusions are being done, and we should not be referring to release triage issues such as #6421

[smlambert]

Should be referencing actual issues that articulate the intermittent failure (look in aqa-tests, infrastructure, and JBS existing issues that describe the problem, if an issue does not exist that describes the actual type of failure, then we should create one, some testcases may be failing in the same way, and can be grouped under the same issue)

[adamfarley]

I am looking at the issue links under which these exclusions are being done, and we should not be referring to release triage issues such as #6421

Fair enough. Will screen them out.

[adamfarley]

It seems many of the triage issues have expired job links, so I'm going through each of the failing unit tests and identifying the actual problem for each based on more recent test runs. I'll keep an eye out for failures sharing symptoms (with each other and existing issues).

Plan: For each unreliable test:

• If a test is linked to a triage issue, comment out the line.
• Uncomment the line after one of these:
  • Finding an issue for the failure
  • Finding a recent failure and raising an issue
• Remove the line if there are no open issues, and the test has passed 100% of the time in recent runs.

Status

JDK8: Complete.

JDK11: Complete. - https://ci.adoptium.net/job/Grinder/16033

JDK17: Complete. - https://ci.adoptium.net/view/Test_grinder/job/Grinder/16186/

• RiscV Grinders:
  • https://ci.adoptium.net/job/Grinder/16235/ - Passed.
  • https://ci.adoptium.net/job/Grinder/16236/ - passed until the node dropped. Issue raised: System unavailable: test-rise-ubuntu2404-riscv64-6 infrastructure#4248

JDK21: Complete. - https://ci.adoptium.net/job/Grinder/16196/

JDK25: Grinders rerunning. - https://ci.adoptium.net/job/Grinder/16283/

• Riscv grinder rerunning: https://ci.adoptium.net/job/Grinder/16290/

[adamfarley]

The intermittent failures for JDK8-JDK21 are complete.

JDK25 has about 150 intermittently failing tests for review, so I'd like to work on that in a separate PR.

JDK8-21 test runs are listed below. Once complete, I'll post a message in testing-aqavit requesting reviews.

• JDK8: https://ci.adoptium.net/job/Grinder/16341/
• JDK11: https://ci.adoptium.net/job/Grinder/16336/
• JDK17: https://ci.adoptium.net/job/Grinder/16337/
• JDK21: https://ci.adoptium.net/job/Grinder/16338/

Update: The tests are successfully excluded.

[smlambert]

Thanks @adamfarley 👍