Prebuilt inference-engine binaries for anira. Each backend is built from source (or repackaged from an upstream prebuilt) and published as GitHub release archives that anira's CMake downloads at configure time.
| Backend | C API | Upstream | lib name | License |
|---|---|---|---|---|
| TFLite | TfLite* |
tensorflow/lite | tensorflowlite_c |
Apache-2.0 |
| LiteRT | LiteRt* |
google-ai-edge/LiteRT | LiteRt |
Apache-2.0 |
| ONNXRuntime | — | microsoft/onnxruntime | onnxruntime |
MIT |
| LibTorch | — | pytorch/pytorch | torch |
BSD-3 |
| ExecuTorch | — | pytorch/executorch | executorch |
BSD-3 |
TFLite and LiteRT are two C APIs for the same runtime (LiteRT is the rebranded TensorFlow
Lite): TfLite* is the mature legacy API; LiteRt* is LiteRT's newer native API. Pick one.
LibTorch and ExecuTorch are two PyTorch C++ runtimes: LibTorch is the full desktop runtime;
ExecuTorch is the on-device runtime that runs ahead-of-time-exported .pte models. We ship a
generic ExecuTorch (full CPU op set + XNNPACK, not a per-model selective build), so one
package loads any .pte. Both are consumed via find_package (Torch / executorch).
This repo is licensed Apache-2.0; the published binaries follow their upstream licenses (above).
What ships per target — shared and/or static:
| Target | TFLite | LiteRT | ONNXRuntime | LibTorch | ExecuTorch |
|---|---|---|---|---|---|
| macOS x86_64 | shared · static | shared · static | shared · static | shared | static |
| macOS arm64 | shared · static | shared · static | shared · static | shared | static |
| macOS universal | shared · static | shared · static | shared · static | shared | static |
| Linux x86_64 | shared · static | shared · static | shared · static | shared | static |
| Linux aarch64 | shared · static | shared · static | shared · static | shared | static |
| Windows x86_64 | shared · static ¹ | shared · static ¹ | shared · static ¹ | shared | static |
| Windows arm64 | shared · static ¹ | shared · static ¹ | shared · static ¹ | shared | static |
Android (arm64-v8a + x86_64) |
shared · static | shared · static | shared · static | — | — |
| iOS (xcframework) | static | static | static | — | — |
| WASM (Emscripten) | — | — | static ² | — | — |
macOS shared dylibs are Developer ID code-signed (Hardened Runtime, timestamped); the
consuming app re-signs/notarizes on embed.
¹ Windows
staticalso ships aDebugvariant.
² Emscripten static archive — build flags and consumer requirements in
engines/onnxruntime.
ExecuTorch is static-only, built from source on every leg (no upstream prebuilt desktop runtime), CPU-first (XNNPACK + optimized kernels everywhere; CoreML/MLX wired in on Apple but off — see
engines/executorch). Android/iOS and the cross-platform Vulkan GPU delegate are deliberate follow-ups.
—= not provided.
Per-backend build details (e.g. LiteRT's LiteRt* vs TfLite* API split, Windows-arm64
from-source toolchain, Android static) live in each engine's README under
engines/<backend>/.
Backends are versioned independently but released together, keyed to the anira
version: tag v2.1.1 builds every backend at its pinned engines/<backend>/VERSION
and publishes all archives to a single release v2.1.1.
