v1.0.0-rc1: Evaluation; unified result types; confidence scores; relation extraction
Pre-release
Pre-release
✨ New features and improvements
- Evaluation feature for all predictive tasks (#247)
- Uncalibrated confidence scores for all predictive tasks (#246)
- Unified predictive task result schemas to Pydantic objects (#241)
- Unified Pydantic-based prompt signature schema (#248)
- New relation extraction task (#242)
- Refactor bridges for easier addition of new task and better maintainability (#248)
🔴 Bug fixes
- Fixed streaming workflow that allocated memory for entire corpus (#248)
⚠️ Backwards incompatibilities
- Classification task requires
mode: Literal[single, multi]argument instead ofmulti_label: bool(#244) - Bridges have some new required methods to implement, and don't need others anymore (#248)
- Tasks have new methods to implement for evaluation and centralized task signature (#241, #248)
📖 Documentation and examples
- Case study on disaster-related tweets (#189)
👥 Contributors
Full Changelog: v0.24.0...v1.0.0-rc1