Add tokenizer-only flag to only download tokenizers from HF or oras
#460
| Job | Run time |
|---|---|
| 4m 0s | |
| 3m 43s | |
| 7m 43s |
tokenizer-only flag to only download tokenizers from HF or oras
#460
| Job | Run time |
|---|---|
| 4m 0s | |
| 3m 43s | |
| 7m 43s |