Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Duemoo authored Oct 5, 2024
1 parent 840bd7b commit 3212bae
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ RUN_NAME=EXP_NAME

export SCRATCH_DIR='PATH_TO_THE_REPOSITORY'

python -m torch.distributed.run --nproc_per_node=4 ${SCRATCH_DIR}/scripts/train.py configs/official/OLMo-1B-105.yaml \
python -m torch.distributed.run --nproc_per_node=4 ${SCRATCH_DIR}/scripts/train.py configs/official/OLMo-7B.yaml \
--run_name=${RUN_NAME} \
--data.paths=[${SCRATCH_DIR}/dolma_extracted/360000-363100.npy] \
--load_path=PATH_TO_THE_CHECKPOINT/step${BASE_STEP}-unsharded \
Expand Down

0 comments on commit 3212bae

Please sign in to comment.