Skip to content

Commit

Permalink
well well well (huggingface#28011)
Browse files Browse the repository at this point in the history
  • Loading branch information
ArthurZucker authored and staghado committed Jan 15, 2024
1 parent 6cf0ed1 commit abc9d03
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/transformers/models/wav2vec2/tokenization_wav2vec2.py
Original file line number Diff line number Diff line change
Expand Up @@ -273,7 +273,7 @@ def _add_tokens(self, new_tokens: Union[List[str], List[AddedToken]], special_to
to_add = []
for token in new_tokens:
if isinstance(token, str):
to_add.append(AddedToken(token, rstrip=False, lstrip=False, normalize=False))
to_add.append(AddedToken(token, rstrip=False, lstrip=False, normalized=False))
else:
to_add.append(token)

Expand Down

0 comments on commit abc9d03

Please sign in to comment.