Skip to content

Commit

Permalink
well well well (#28011)
Browse files Browse the repository at this point in the history
  • Loading branch information
ArthurZucker authored Dec 14, 2023
1 parent 17506d1 commit 131a528
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/transformers/models/wav2vec2/tokenization_wav2vec2.py
Original file line number Diff line number Diff line change
Expand Up @@ -273,7 +273,7 @@ def _add_tokens(self, new_tokens: Union[List[str], List[AddedToken]], special_to
to_add = []
for token in new_tokens:
if isinstance(token, str):
to_add.append(AddedToken(token, rstrip=False, lstrip=False, normalize=False))
to_add.append(AddedToken(token, rstrip=False, lstrip=False, normalized=False))
else:
to_add.append(token)

Expand Down

0 comments on commit 131a528

Please sign in to comment.