Skip to content

Commit

Permalink
clean
Browse files Browse the repository at this point in the history
  • Loading branch information
ArthurZucker committed Jun 10, 2024
1 parent 85c7b69 commit 0a16ca0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tokenizers/src/tokenizer/mod.rs
Original file line number Diff line number Diff line change
Expand Up @@ -560,7 +560,7 @@ where

write!(
f,
"Tokenizer(normalizer={},\npre_tokenizer={},\nmodel={},\npost_processor={},\ndecoder={},\nadded_vocab={},\ntruncation={},\npadding={}\n)",
"Tokenizer(normalizer={}, pre_tokenizer={}, model={}, post_processor={}, decoder={}, added_vocab={}, truncation={}, padding={})",
normalizer_str,
pre_tokenizer_str,
self.model,
Expand Down

0 comments on commit 0a16ca0

Please sign in to comment.