Command failed with exit code 1

stdout: UpdateCTestConfiguration from :/onnxruntime_src/build/Release/Release/DartConfiguration.tcl Parse Config file:/onnxruntime_src/build/Release/Release/DartConfiguration.tcl UpdateCTestConfiguration from :/onnxruntime_src/build/Release/Release/DartConfiguration.tcl Parse Config file:/onnxruntime_src/build/Release/Release/DartConfiguration.tcl Test project /onnxruntime_src/build/Release/Release Constructing a list of tests Done constructing a list of tests Updating test list for fixtures Added 0 tests to meet fixture requirements Checking test dependency graph... Checking test dependency graph end test 1 Start 1: onnxruntime_test_all 1: Test command: /onnxruntime_src/build/Release/Release/onnxruntime_test_all "--gtest_output=xml:/onnxruntime_src/build/Release/Release/onnxruntime_test_all.Release.results.xml" 1: Working Directory: /onnxruntime_src/build/Release/Release 1: Test timeout computed to be: 10800 1: [==========] Running 4837 tests from 316 test suites. 1: [----------] Global test environment set-up. 1: [----------] 1 test from DenormalTest 1: [ RUN ] DenormalTest.DenormalAsZeroTest 1: [ OK ] DenormalTest.DenormalAsZeroTest (0 ms) 1: [----------] 1 test from DenormalTest (0 ms total) 1: 1: [----------] 8 tests from LoggingTestsFixture 1: [ RUN ] LoggingTestsFixture.TestWhereMacro 1: TestBody 1: TestWhereMacro@2025-04-03 23:30:27.345496802 E:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:85 TestBody Testing the WHERE macro. 1: [ OK ] LoggingTestsFixture.TestWhereMacro (0 ms) 1: [ RUN ] LoggingTestsFixture.TestDefaultFiltering 1: TestDefaultFiltering@2025-04-03 23:30:27.345581642 E:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:109 TestBody hello 1: 2025-04-03 23:30:27.345594482 [W:onnxruntime:Default, logging_test.cc:112 TestBody] Warning�[m 1: 2025-04-03 23:30:27.345602642 [E:onnxruntime:Default, logging_test.cc:113 TestBody] Default logger doesn't filter user data�[m 1: 2025-04-03 23:30:27.345607602 [W:onnxruntime:Default, logging_test.cc:115 TestBody] Default logger doesn't filter user data�[m 1: [ OK ] LoggingTestsFixture.TestDefaultFiltering (0 ms) 1: [ RUN ] LoggingTestsFixture.TestLoggerFiltering 1: TestLoggerFiltering@2025-04-03 23:30:27.345624082 V:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:143 TestBody VERBOSE enabled in this logger 1: TestLoggerFiltering@2025-04-03 23:30:27.345636002 E:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:144 TestBody USER data not filtered in this logger 1: [ OK ] LoggingTestsFixture.TestLoggerFiltering (0 ms) 1: [ RUN ] LoggingTestsFixture.TestLoggingManagerCtor 1: [ OK ] LoggingTestsFixture.TestLoggingManagerCtor (0 ms) 1: [ RUN ] LoggingTestsFixture.TestConditionalMacros 1: TestConditionalMacros@2025-04-03 23:30:27.345750282 I:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:189 TestBody Valid logger 1: TestConditionalMacros@2025-04-03 23:30:27.345760082 I:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:190 TestBody Logger is 0x3f6824c0 1: [ OK ] LoggingTestsFixture.TestConditionalMacros (0 ms) 1: [ RUN ] LoggingTestsFixture.TestVLog 1: [ OK ] LoggingTestsFixture.TestVLog (0 ms) 1: [ RUN ] LoggingTestsFixture.TestTruncation 1: [ OK ] LoggingTestsFixture.TestTruncation (0 ms) 1: [ RUN ] LoggingTestsFixture.TestStreamMacroFromConditionalWithoutCompoundStatement 1: TestStreamMacroFromConditionalWithoutCompoundStatement@2025-04-03 23:30:27.345835802 V:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:309 operator() true 1: TestStreamMacroFromConditionalWithoutCompoundStatement@2025-04-03 23:30:27.345848722 V:onnxruntime:/onnxruntime_src/onnxruntime/test/common/logging/logging_test.cc:311 operator() false 1: [ OK ] LoggingTestsFixture.TestStreamMacroFromConditionalWithoutCompoundStatement (0 ms) 1: [----------] 8 tests from LoggingTestsFixture

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-03 23:30:27,302 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-03 23:30:27,309 build [INFO] - Build started 2025-04-03 23:30:27,309 build [INFO] - Running tests for Release configuration 2025-04-03 23:30:27,309 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 Errors while running CTest Output from these tests are in: /onnxruntime_src/build/Release/Release/Testing/Temporary/LastTest.log Use "--rerun-failed --output-on-failure" to re-run the failed cases verbosely. Traceback (most recent call last): File "/onnxruntime_src/tools/ci_build/build.py", line 3363, in <module> sys.exit(main()) File "/onnxruntime_src/tools/ci_build/build.py", line 3264, in main run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs) File "/onnxruntime_src/tools/ci_build/build.py", line 2400, in run_onnxruntime_tests run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path) File "/onnxruntime_src/tools/ci_build/build.py", line 915, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) File "/onnxruntime_src/tools/python/util/run.py", line 50, in run completed_process = subprocess.run( File "/opt/python/cp310-cp310/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/bin/ctest', '--build-config', 'Release', '--verbose', '--timeout', '10800']' returned non-zero exit status 8.

Action failed with error: Command "docker run --rm --volume /mnt/vss/_work/onnxruntime/onnxruntime:/onnxruntime_src --volume /mnt/vss/_work/_temp:/onnxruntime_src/build --volume /home/cloudtest/.cache:/home/onnxruntimedev/.cache --volume /data/models:/data/models:ro --volume /home/cloudtest/.onnx:/home/onnxruntimedev/.onnx -w /onnxruntime_src -e ALLOW_RELEASED_ONNX_OPSET_ONLY=0 -e NIGHTLY_BUILD=1 ghcr.io/microsoft/onnxruntime/onnxruntimecpubuildpythonaarch64:sha256-50dc94fa2b0f25a5efb5d672a34bb4f6860817e35ce884c9f2df2ec00d3666df /bin/bash -c set -ex; PATH=/opt/python/cp310-cp310/bin:$PATH python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test" failed with exit code 1

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-03 23:12:30,982 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-03 23:12:30,989 build [INFO] - Build started 2025-04-03 23:12:30,990 build [INFO] - Building targets for Release configuration 2025-04-03 23:12:30,990 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j8 2025-04-03 23:30:20,411 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc INFO:auditwheel.main_repair:Repairing onnxruntime-1.22.0.dev20250403-cp310-cp310-linux_aarch64.whl DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.22.0 DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree:lddtree(onnxruntime/capi/libonnxruntime.so.1.22.0) DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmprq6nbmph/onnxruntime/capi'] DEBUG:auditwheel.lddtree:lddtree(/lib64/libdl-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libc-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/ld-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/librt-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libpthread-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libstdc++.so.6.0.25) DEBUG:auditwheel.lddtree:lddtree(/lib64/libm-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libgcc_s-8-20210514.so.1) DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_4.0.0 DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_3.0 DEBUG:auditwheel.wheel_abi:key libdl.so.2, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libm.so.6, value GLIBC_2.27 DEBUG:auditwheel.wheel_abi:key libm.so.6, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libpthread.so.0, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.14 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.17 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.22 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value CXXABI_1.3.8 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.18 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.19 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, v

stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.