v0.15.1: Async batching for Outlines models; remove model default values
Pre-release
Pre-release
✨ New features and improvements
- Use async batching for models with Outlines when Outlines doesn't support batching natively (#170)
🔴 Bug fixes
- Remove default model values like
max_tokensthat could cause crashes for model not supporting these kwargs (#169)
⚠️ Backwards incompatibilities
-
📖 Documentation and examples
-
👥 Contributors
Full Changelog: v0.15.0...v0.15.1