Actions: huggingface/tokenizers
Actions
35 workflow run results
35 workflow run results
huggingface_hub<1.0
Documentation
#1408:
Pull request #1385
opened
by
Wauplin
Clone
on Tokenizer
, add Encoding.into_tokens()
method
Documentation
#1404:
Pull request #1381
opened
by
epwalsh
token_to_id
Documentation
#1402:
Pull request #1378
opened
by
chris-ha458
pre_tokenizers
] Fix sentencepiece based Metaspace
Documentation
#1393:
Pull request #1357
synchronize
by
ArthurZucker
pre_tokenizers
] Fix sentencepiece based Metaspace
Documentation
#1392:
Pull request #1357
opened
by
ArthurZucker