Release 2.20.1
Bug Fixes and Other Changes
- Fixed a memory safety bug in FastWordpieceTokenizer concerning StringVocab lifetime. This prevents temporary copies that were previously invalidating std::string_view references to internal vocabulary data, ensuring memory stability during tokenization.
- Update Version for 2.20.1
Thanks to our Contributors
This release contains contributions from many people at Google, as well as:
C. Antonio Sánchez