Skip to content

Commit

Permalink
Update tokenizer names in playground
Browse files Browse the repository at this point in the history
  • Loading branch information
xenova committed Feb 21, 2024
1 parent fc16dc7 commit 3f5dc16
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions examples/tokenizer-playground/src/App.jsx
Original file line number Diff line number Diff line change
Expand Up @@ -70,8 +70,8 @@ function App() {
<option value="Xenova/gpt-4">gpt-4 / gpt-3.5-turbo / text-embedding-ada-002</option>
<option value="Xenova/text-davinci-003">text-davinci-003 / text-davinci-002</option>
<option value="Xenova/gpt-3">gpt-3</option>
<option value="hf-internal-testing/dummy-gemma">Gemma</option>
<option value="hf-internal-testing/llama-tokenizer">LLaMA / Llama 2</option>
<option value="Xenova/gemma-tokenizer">Gemma</option>
<option value="Xenova/llama-tokenizer">LLaMA / Llama 2</option>
<option value="Xenova/t5-small">T5</option>
<option value="Xenova/bert-base-cased">bert-base-cased</option>
</select>
Expand Down

0 comments on commit 3f5dc16

Please sign in to comment.