Description
Describe the issue
There are two released artifacts for the v1.20.1:
The first one won't run onmacOS Sequoia with M3 with unloadable mach-o file type 10
error:
The XCode Toolchain I used has the following version:
$ pkgutil --pkg-info=com.apple.pkg.CLTools_Executables
package-id: com.apple.pkg.CLTools_Executables
version: 16.2.0.0.1.1733547573
volume: /
location: /
install-time: 1734109928
The Second one (onnxruntime-osx-universal2-1.20.1.tgz) has both x86 and arm64 as expected. But runtime is very slow. For SLM models such as llama3.2-1B ONNX we are getting around 120 tokens per second when built from source, whereas with this version it's about 1 token per second!. Perhaphs a Debug
version is included in the released tarball?
Eitherway, it's impossible to use onnruntime 1.20.1 on macOS uness built from source.
Urgency
Many of the developers use MacBook for their development platform. Since the release is broken for Mac, it would be very nice to address this for the upcoming release v1.20.1.
Target platform
macOS M3 running Sequoia 15.3.1 with XCode toolchain 16.2.0.0.1.1733547573 or later
Build script
Compile any c++ progarm linking with the onnxruntime on macOS Sequoia and the weeor will show up during running.
Error / output
dyld[68458]: Library not loaded: @rpath/libonnxruntime.1.20.1.dylib
Referenced from: /Users/avijitchakraborty/workspace/dev/ort-genai-contrib/examples/slm_engine/build_scripts/builds/Darwin-arm64/install/bin/slm-runner
Reason: tried: '/Users/avijitchakraborty/workspace/dev/ort-genai-contrib/examples/slm_engine/build_scripts/builds/Darwin-arm64/install/bin/libonnxruntime.1.20.1.dylib'
(unloadable mach-o file type 10 '/Users/avijitchakraborty/workspace/dev/ort-genai-contrib/examples/slm_engine/build_scripts/builds/Darwin-arm64/install/bin/libonnxruntime.1.20.1.dylib'),
'/Users/avijitchakraborty/workspace/dev/ort-genai-contrib/examples/slm_engine/build_scripts/builds/Darwin-arm64/install/bin/libonnxruntime.1.20.1.dylib' (unloadable mach-o file type 10
'/Users/avijitchakraborty/workspace/dev/ort-genai-contrib/examples/slm_engine/build_scripts/builds/Darwin-arm64/install/bin/libonnxruntime.1.20.1.dylib')
Visual Studio Version
N/A
GCC / Compiler Version
Apple clang version 16.0.0 (clang-1600.0.26.4) Target: arm64-apple-darwin24.3.0