Update train code to support the new tokenizer (#2498)

lm-sys · Sep 30, 2023 · c478bbf · c478bbf
1 parent f70de6b
commit c478bbf
Show file tree

Hide file tree

Showing 4 changed files with 4,020 additions and 5,349 deletions.
diff --git a/README.md b/README.md
@@ -284,7 +284,7 @@ pip3 install -e ".[train]"
 - You can use the following command to train Vicuna-7B with 4 x A100 (40GB). Update `--model_name_or_path` with the actual path to LLaMA weights and `--data_path` with the actual path to data.
 ```bash
 torchrun --nproc_per_node=4 --master_port=20001 fastchat/train/train_mem.py \
-    --model_name_or_path ~/model_weights/llama-7b  \
+    --model_name_or_path meta-llama/Llama-2-7b-hf \
     --data_path data/dummy_conversation.json \
     --bf16 True \
     --output_dir output_vicuna \