[PretrainedTokenizer] add some of the most important functions to the doc#27313
Merged
ArthurZucker merged 1 commit intomainfrom update-tokenizer-docNov 6, 2023
+4
PretrainedTokenizer] add some of the most important functions to the doc#27313