Skip to content

Commit

Permalink
chore(deps): update tokenizers requirement from 0.19.1 to 0.20.1
Browse files Browse the repository at this point in the history
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](huggingface/tokenizers@v0.19.1...v0.20.1)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
  • Loading branch information
dependabot[bot] authored Oct 14, 2024
1 parent 214c86b commit 68604af
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ rand = { version = "0.8.5", optional = true }
[dev-dependencies]
criterion = "0.5.1"
rand = "0.8.5"
tokenizers = "0.19.1"
tokenizers = "0.20.1"

[[bench]]
name = "tokenize"
Expand Down

0 comments on commit 68604af

Please sign in to comment.