GitHub action builds do not submit status to CDash dashboard

[dzenanz]

Taking example from today, PR #5512, only 8 builds appear on the dashboard. 7 have PR number in the name, and all 8 have branch name:

Most important in this case was that information for the failing build, macOS-x86_64-rosetta, do not appear on the dashboard, despite the log claiming it was submitted.

It looks like only the Azure builds appear on CDash.

[zackgalbreath]

I took a closer look on the server hosting open.cdash.org and I found two parsed Test.xml files for the build macOS-Build17495990688-vtksysConfigureFix. The build with the failing test occurred first (at 15:16 UTC), and then the building with 100% passing tests occurred about an hour later (at 16:37 UTC).

CDash has a feature that allows us to automatically replace faulty build contents (i.e. in the case of a retry). I'm not 100% sure, but I believe that's what occurred here.

[dzenanz]

It is probably the other build from that group, macOS-Python, overwriting the result.

[dzenanz]

Here is log tail for PR 5518:

2025-09-10T02:29:56.0595870Z Total Test time (real) = 459.46 sec
2025-09-10T02:29:56.0595880Z 
2025-09-10T02:29:56.0595930Z The following tests FAILED:
2025-09-10T02:29:56.0596170Z 	808 - itkFFTConvolutionImageFilterStreamingValidTest (Failed) ITKConvolution
2025-09-10T02:29:56.2044550Z SetCTestConfiguration:BuildDirectory:/Users/runner/work/ITK/ITK/build
2025-09-10T02:29:56.2044720Z SetCTestConfiguration:SourceDirectory:/Users/runner/work/ITK/ITK
2025-09-10T02:29:56.2044870Z SetCTestConfigurationFromCMakeVariable:DropMethod:CTEST_DROP_METHOD
2025-09-10T02:29:56.2044960Z SetCTestConfiguration:DropMethod:https
2025-09-10T02:29:56.2045090Z SetCTestConfigurationFromCMakeVariable:DropSite:CTEST_DROP_SITE
2025-09-10T02:29:56.2045410Z SetCTestConfiguration:DropSite:open.cdash.org
2025-09-10T02:29:56.2045580Z SetCTestConfigurationFromCMakeVariable:DropLocation:CTEST_DROP_LOCATION
2025-09-10T02:29:56.2045710Z SetCTestConfiguration:DropLocation:/submit.php?project=Insight
2025-09-10T02:29:56.2045830Z 	Add file: /Users/runner/work/ITK/ITK/ITK-dashboard/dashboard.cmake
2025-09-10T02:29:56.2048310Z 	Add file: /Users/runner/work/ITK/ITK/ITK-dashboard/itk_common.cmake
2025-09-10T02:29:56.2069250Z Submit files
2025-09-10T02:29:56.2069400Z    SubmitURL: https://open.cdash.org/submit.php?project=Insight
2025-09-10T02:29:56.2228580Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:56.2228950Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:56.2237820Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Update.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Update.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=f5ec00571e6528d6f6646c59bd6fc1ee Size: 618
2025-09-10T02:29:56.6282100Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Update.xml
2025-09-10T02:29:56.6283040Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:56.6283620Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:56.6307430Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Configure.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Configure.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=e4dd642a79a7b328265c12fb2cc62ec1 Size: 45678
2025-09-10T02:29:57.1277810Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Configure.xml
2025-09-10T02:29:57.1278820Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:57.1279420Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:57.1286560Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Build.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Build.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=b9403263987fc524337fb54f31266bcd Size: 1169
2025-09-10T02:29:57.5027900Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Build.xml
2025-09-10T02:29:57.5028540Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:57.5029240Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:57.5183810Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Test.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Test.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=d101c40c9672153fff063f26f2c583e2 Size: 6985202
2025-09-10T02:29:58.7708930Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Test.xml
2025-09-10T02:29:58.7711620Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:58.7712510Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:58.7722540Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Notes.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Notes.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=c143e5be650106e7d62c517bb3068701 Size: 18166
2025-09-10T02:29:59.1936620Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Notes.xml
2025-09-10T02:29:59.1937590Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:59.1938190Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:59.1981460Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Done.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Done.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=69bcce377c2e43f63a4ded0ea108147b Size: 108
2025-09-10T02:29:59.5667450Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Done.xml
2025-09-10T02:29:59.5668760Z    Submission successful
2025-09-10T02:29:59.5704850Z CMake Warning at /Users/runner/work/ITK/ITK/ITK-dashboard/itk_common.cmake:502 (message):
2025-09-10T02:29:59.5706520Z   test_return did not complete without warnings, errors, or failures.
2025-09-10T02:29:59.5707590Z Call Stack (most recent call first):
2025-09-10T02:29:59.5709310Z   /Users/runner/work/ITK/ITK/ITK-dashboard/github_actions_dashboard.cmake:89 (include)
2025-09-10T02:29:59.5710890Z   /Users/runner/work/ITK/ITK/ITK-dashboard/dashboard.cmake:11 (include)
2025-09-10T02:29:59.5711770Z 
2025-09-10T02:29:59.5711800Z 
2025-09-10T02:29:59.5712520Z CMake Error at /Users/runner/work/ITK/ITK/ITK-dashboard/itk_common.cmake:508 (message):
2025-09-10T02:29:59.5714100Z   ci_completed_successfully did not complete without warnings, errors, or
2025-09-10T02:29:59.5715150Z   failures.
2025-09-10T02:29:59.5715710Z Call Stack (most recent call first):
2025-09-10T02:29:59.5716930Z   /Users/runner/work/ITK/ITK/ITK-dashboard/github_actions_dashboard.cmake:89 (include)
2025-09-10T02:29:59.5718560Z   /Users/runner/work/ITK/ITK/ITK-dashboard/dashboard.cmake:11 (include)
2025-09-10T02:29:59.5719410Z 
2025-09-10T02:29:59.5719420Z 
2025-09-10T02:29:59.5968590Z ##[error]Process completed with exit code 255.
2025-09-10T02:29:59.6222100Z Post job cleanup.
2025-09-10T02:30:00.0099500Z [command]/opt/homebrew/bin/git version
2025-09-10T02:30:00.0386360Z git version 2.51.0
2025-09-10T02:30:00.0448330Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/2ed409e4-989f-4004-ba08-86abf4d82c42/.gitconfig'
2025-09-10T02:30:00.0449130Z Temporarily overriding HOME='/Users/runner/work/_temp/2ed409e4-989f-4004-ba08-86abf4d82c42' before making global git config changes
2025-09-10T02:30:00.0449850Z Adding repository directory to the temporary git global config as a safe directory
2025-09-10T02:30:00.0450440Z [command]/opt/homebrew/bin/git config --global --add safe.directory /Users/runner/work/ITK/ITK
2025-09-10T02:30:00.0540730Z [command]/opt/homebrew/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-09-10T02:30:00.0706790Z [command]/opt/homebrew/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-09-10T02:30:00.1474310Z [command]/opt/homebrew/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-09-10T02:30:00.1523720Z http.https://github.com/.extraheader
2025-09-10T02:30:00.1533020Z [command]/opt/homebrew/bin/git config --local --unset-all http.https://github.com/.extraheader
2025-09-10T02:30:00.1591090Z [command]/opt/homebrew/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-09-10T02:30:00.2267490Z Cleaning up orphan processes