move tokenizer utils (pytorch#805)

yanbing-j · Jul 17, 2024 · a30fd3d · a30fd3d
1 parent af8806b
commit a30fd3d
Show file tree

Hide file tree

Showing 2 changed files with 0 additions and 0 deletions.
diff --git a/unsupported/llama2.c/runner-utils/LICENSE → unsupported/llama2.c/LICENSE b/unsupported/llama2.c/runner-utils/LICENSE → unsupported/llama2.c/LICENSE
diff --git a/...ported/llama2.c/runner-utils/tokenizer.py → unsupported/llama2.c/tokenizer.py b/...ported/llama2.c/runner-utils/tokenizer.py → unsupported/llama2.c/tokenizer.py