v0.7.5

[0.7.5] - 2026-06-05

Changed

• Upgraded to ORT v1.26.0
• Upgraded to ORT GenAI v0.14.0

v0.7.4

[0.7.4] - 2026-05-24

Changed

• Do not specify go patch version in go.mod
• Fixes for release docker image build and push

v0.7.3

[0.7.3] - 2026-05-20

Changed

• Fix panic on double-close (thanks @sananguliyev)
• Upgraded to ORT v1.25.1
• Test structure improvements
• Documentation and examples improvements (thanks @kepae)

New Contributors

• @kepae made their first contribution in #125
• @sananguliyev made their first contribution in #131

Full Changelog: v0.7.2...v0.7.3

v0.7.2

[0.7.2] - 2026-04-22

Changed

• Upgraded to ORT v1.25.0

v0.7.1

[0.7.1] - 2026-04-19

Changed

• Breaking: Added context.Context to many functions for graceful cancellation
• Experimental: Added WithGenerativeEngine to ORT, to enable concurrent inferencing and intelligent batching
• Added locks to protect against concurrent model and pipeline initialisations
• Added 2-bit bucketing to XLA backend for reduced padding overhead
• Upgraded to GoMLX v0.27.3
• Upgraded to ORT v1.24.4
• Upgraded to ORT GenAI v0.13.1

v0.7.0

[0.7.0] - 2026-03-30

Changed

• Added QuestionAnsweringPipeline
• Added ConstrainedGeneration, Tools and Guidance to TextGenerationPipeline
• Upgraded to GoMLX v0.27.2
  • Fixes multiple quantization issues in simple Go backend
• Upgraded to ORT v1.24.4
• Upgraded to ORT GenAI v0.12.2
• Replaced Go Tokenizers with GoMLX version
  • Supports Pair Tokenization
  • Further reduces dependencies
• Fix: Allow use of SOFTMAX in TextClassificationPipeline
• Breaking: Remove CLI to simplify dependencies (can be reintroduced as a separate library on request)

v0.6.5

[0.6.5] - 2026-03-17

Changed

• Upgraded to GoMLX v0.27.1
  • Includes performance improvements, new onnx ops and quantization types for Go and XLA backends
  • See here for details
• Upgraded to ORT v1.24.3
• Upgraded to ORT GenAI v0.12.1
• Upgraded to Tokenizers v1.26.0
• Added WithProfiling and WithOptimizedModelFilePath options

v0.6.4

[0.6.4] - 2026-03-02

• bugfix: correct wrong input token creation in feature extraction for models with eos tokens.

v0.6.3

[0.6.3] - 2026-02-26

Changed

• Upgraded to ORT GenAI v0.12.0
• Upgraded to ORT v1.24.2
• Upgraded to Go v1.26.0
• Upgraded tokenizers to v1.25.0
• Added WithLogSeverityLevel, WithEnvLoggingLevel, WithGraphOptimizationLevel and WithExtraExecutionProvider options
• Separated TensorRT and NvTensorRTRTX
• Memory usage and bugfixes to generative pipelines

v0.6.2

First release of 2026!

Changed

• Added TabularPipeline to run onnx exports of classical ML models (regression or classification) from, e.g., sklearn
• Added multimodal support for text generation pipeline (kudos to @ajroetker)
• Memory mapped loading of onnx models on native fs to reduce memory usage

Full Changelog: v0.6.1...v0.6.2