Actions: huggingface/tokenizers
Actions
115 workflow runs
115 workflow runs
Clone
on Tokenizer
, add Encoding.into_tokens()
method (#…
Build documentation
#130:
Commit daf3616
pushed
by
Narsil
pre_tokenizers
] Fix sentencepiece based Metaspace (#1357)
Build documentation
#128:
Commit f55822b
pushed
by
ArthurZucker