v0.9.0

Update tiktoken-rs to 0.12.0

Full Changelog: v0.8.0...v0.9.0

v0.8.0

Full Changelog: v0.7.0...v0.8.0

To support tiktoken-rs v0.10.0, we had to add new fields to the struct.
To make future changes easier, we changed the API to avoid direct access to the struct.

v0.7.0

To support tiktoken-rs v0.10.0, we had to add new fields to the struct.

v0.6.0

Update tiktoken-rs to 0.9.1

v0.5.0

v0.5.0

v0.4.1

v0.4.1

v0.4.0

Update tiktoken-rs to 0.7.0

v0.3.0

v0.3.0

v0.2.2

v0.2.2

v0.2.1

Improved compilation options