Skip to content

v1.0.0-rc1: Evaluation; unified result types; confidence scores; relation extraction

Pre-release
Pre-release

Choose a tag to compare

@rmitsch rmitsch released this 28 Dec 12:20

✨ New features and improvements

  • Evaluation feature for all predictive tasks (#247)
  • Uncalibrated confidence scores for all predictive tasks (#246)
  • Unified predictive task result schemas to Pydantic objects (#241)
  • Unified Pydantic-based prompt signature schema (#248)
  • New relation extraction task (#242)
  • Refactor bridges for easier addition of new task and better maintainability (#248)

🔴 Bug fixes

  • Fixed streaming workflow that allocated memory for entire corpus (#248)

⚠️ Backwards incompatibilities

  • Classification task requires mode: Literal[single, multi] argument instead of multi_label: bool (#244)
  • Bridges have some new required methods to implement, and don't need others anymore (#248)
  • Tasks have new methods to implement for evaluation and centralized task signature (#241, #248)

📖 Documentation and examples

  • Case study on disaster-related tweets (#189)

👥 Contributors

@rmitsch, @adgianv


Full Changelog: v0.24.0...v1.0.0-rc1