Skip to content

Commit

Permalink
awq-py : fix typo in awq-py/README.md (ggerganov#4947)
Browse files Browse the repository at this point in the history
  • Loading branch information
ziliangpeng authored Jan 15, 2024
1 parent ddb008d commit d9aa4ff
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion awq-py/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ Example for llama model
# For llama7b and llama2 models
python convert.py models/llama-7b/ --awq-path awq_cache/llama-7b-w4-g128.pt --outfile models/llama_7b_fp16.gguf
# For mistral and mpt models
python convert-hf-to-gguf.py models/mpt-7b/ --awq-path awq_cache/llama-7b-w4-g128.pt --outfile models/mpt_7b_fp16.gguf
python convert-hf-to-gguf.py models/mpt-7b/ --awq-path awq_cache/mpt-7b-w4-g128.pt --outfile models/mpt_7b_fp16.gguf
```

## Quantize
Expand Down

0 comments on commit d9aa4ff

Please sign in to comment.