Skip to content

v0.15.1: Async batching for Outlines models; remove model default values

Pre-release
Pre-release

Choose a tag to compare

@rmitsch rmitsch released this 03 Oct 16:11

✨ New features and improvements

  • Use async batching for models with Outlines when Outlines doesn't support batching natively (#170)

🔴 Bug fixes

  • Remove default model values like max_tokens that could cause crashes for model not supporting these kwargs (#169)

⚠️ Backwards incompatibilities

-

📖 Documentation and examples

-

👥 Contributors

@rmitsch, @ivyleavedtoadflax


Full Changelog: v0.15.0...v0.15.1