Skip to content

Commit b45545d

Browse files
Update tokenizers requirement from 0.22.1 to 0.23.1
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version. - [Release notes](https://github.com/huggingface/tokenizers/releases) - [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md) - [Commits](huggingface/tokenizers@v0.22.1...v0.23.1) --- updated-dependencies: - dependency-name: tokenizers dependency-version: 0.23.1 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
1 parent 4a053b8 commit b45545d

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

Cargo.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,7 @@ cudarc = { version = "0.19", optional = true, default-features = false, features
5252
"dynamic-linking"
5353
] }
5454
ureq = { version = "3.1.4", default-features = false, features = ["rustls", "gzip"] }
55-
tokenizers = { version = "0.22.1", optional = true }
55+
tokenizers = { version = "0.23.1", optional = true }
5656
lru = { version = "0.16.2", default-features = false }
5757

5858

0 commit comments

Comments
 (0)