Skip to content

Commit c9b9356

Browse files
Update tokenizers requirement from 0.21.1 to 0.22.1
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version. - [Release notes](https://github.com/huggingface/tokenizers/releases) - [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md) - [Commits](huggingface/tokenizers@v0.21.1...v0.22.1) --- updated-dependencies: - dependency-name: tokenizers dependency-version: 0.22.1 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
1 parent 83bf1c6 commit c9b9356

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

Cargo.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ ort = { version = "=2.0.0-rc.10", default-features = false, optional = true, fea
4444
"std",
4545
] }
4646
hf-hub = { version = "0.4.3", default-features = false, features = ["ureq", "native-tls"] }
47-
tokenizers = { version = "0.21.1" }
47+
tokenizers = { version = "0.22.1" }
4848
slsl = { version = "0.0.6", features = ["rayon"] }
4949

5050

0 commit comments

Comments
 (0)