[PretrainedTokenizer] add some of the most important functions to t…

…he doc (huggingface#27313)
EduardoPach · Nov 19, 2023 · 31237be · 31237be
1 parent 739f348
commit 31237be
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/docs/source/en/main_classes/tokenizer.md b/docs/source/en/main_classes/tokenizer.md
@@ -55,6 +55,8 @@ to a given token).
 
 [[autodoc]] PreTrainedTokenizer
     - __call__
+    - add_tokens
+    - add_special_tokens
     - apply_chat_template
     - batch_decode
     - decode
@@ -69,6 +71,8 @@ loaded very simply into 🤗 transformers. Take a look at the [Using tokenizers
 
 [[autodoc]] PreTrainedTokenizerFast
     - __call__
+    - add_tokens
+    - add_special_tokens
     - apply_chat_template
     - batch_decode
     - decode