WIP: Documenting intermittently failing tests in perf and system

perf/unreliables/ProblemList_openjdk11.txt

@@ -0,0 +1,18 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+
+renaissance-movie-lens_0 https://github.com/adoptium/aqa-tests/issues/6427 linux-s390x 20250716
+

perf/unreliables/ProblemList_openjdk17.txt

@@ -0,0 +1,16 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+

perf/unreliables/ProblemList_openjdk21.txt

@@ -0,0 +1,16 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+

perf/unreliables/ProblemList_openjdk25.txt

@@ -0,0 +1,16 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+

perf/unreliables/ProblemList_openjdk8.txt

@@ -0,0 +1,16 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_info
+

perf/unreliables/README.md

@@ -0,0 +1,8 @@
+## Unreliables
+
+This folder contains a selection of text files using the jtreg-exclude format.
+
+Each file contains a list of perf tests known to fail intermittently.
+
+If a test never passes, then please use the playlist files to disable the tests.
+

system/unreliables/ProblemList_openjdk11.txt

@@ -0,0 +1,22 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+
+DBBLoadTest_5m_0 https://github.com/adoptium/aqa-tests/issues/6427 linux-s390x 20250716
+MiniMix_aot_5m_0 https://github.com/adoptium/aqa-tests/issues/6427 aix-all 20250716
+OAuthTest_0 https://github.com/adoptium/aqa-tests/issues/3237 linux-arm 20220119
+TestJlmRemoteClassAuth_2 https://github.com/adoptium/aqa-tests/issues/5096 linux-arm 20240225
+TestJlmRemoteThreadNoAuth_2 https://github.com/adoptium/aqa-tests/issues/5096 linux-arm 20240225
+

system/unreliables/ProblemList_openjdk17.txt

@@ -0,0 +1,20 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+
+TestJlmRemoteMemoryNoAuth_1 https://github.com/adoptium/aqa-tests/issues/6422 linux-aarch64 20250717
+ConcurrentLoadTest_5m https://github.com/adoptium/aqa-tests/issues/3819 aix-all 20220630
+MiniMix_aot_5m https://github.com/adoptium/aqa-tests/issues/3819 aix-all 20220630
+

system/unreliables/ProblemList_openjdk21.txt

@@ -0,0 +1,20 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+
+LangLoadTest_5m_1 https://github.com/adoptium/aqa-tests/issues/6421 linux-riscv64
+ConcurrentLoadTest_5m https://github.com/adoptium/aqa-tests/issues/3819 aix-all 20220630
+MiniMix_aot_5m https://github.com/adoptium/aqa-tests/issues/3819 aix-all 20220630
+

system/unreliables/ProblemList_openjdk25.txt

@@ -0,0 +1,20 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_information
+
+ConcurrentLoadTest_5m https://github.com/adoptium/aqa-tests/issues/3819 aix-all 20220630
+# MiniMix_aot_5m_0 https://github.com/adoptium/aqa-tests/issues/6420 linux-s390x 20250715
+MiniMix_aot_5m https://github.com/adoptium/aqa-tests/issues/3819 aix-all,linux-s390x 20220630
+

system/unreliables/ProblemList_openjdk8.txt

@@ -0,0 +1,25 @@
+############################################################################
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#      https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#############################################################################
+
+# test_name issue_if_any platforms date_seen_YYYYMMDD further_info
+
+MauveSingleThrdLoad_HS_5m_0 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64,linux-aarch64 20250717
+MauveSingleThrdLoad_HS_5m_1 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64,linux-aarch64 20250717
+MauveSingleInvocLoad_HS_5m_0 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64,linux-aarch64 20250717
+MauveSingleInvocLoad_HS_5m_1 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64,linux-aarch64 20250717
+MauveMultiThrdLoad_5m_0 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64 20250717
+MauveMultiThrdLoad_5m_1 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64 20250717
+MiniMix_5m_1 https://github.com/adoptium/aqa-tests/issues/6429 linux-x64 20250717
+OAuthTest_0 https://github.com/adoptium/aqa-tests/issues/6429 linux-aarch64 20250717
+

system/unreliables/README.md

@@ -0,0 +1,8 @@
+## Unreliables
+
+This folder contains a selection of text files using the jtreg-exclude format.
+
+Each file contains a list of system tests known to fail intermittently.
+
+If a test never passes, then please exclude them via the playlist.xml files in the specific test target directories.
+