Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ochafik committed Oct 2, 2024
1 parent 9e502e8 commit b559d64
Showing 1 changed file with 0 additions and 8 deletions.
8 changes: 0 additions & 8 deletions examples/agent/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,19 +25,11 @@
-hfr meetkai/functionary-small-v3.2-GGUF -hff functionary-small-v3.2.Q4_0.gguf \
--chat-template "$( python scripts/get_hf_chat_template.py meetkai/functionary-medium-v3.2 )"

./llama-server --jinja -fa --verbose \
-m ~/Downloads/functionary-small-v3.2.Q4_0.gguf \
--chat-template "$( python scripts/get_hf_chat_template.py meetkai/functionary-medium-v3.2 )"

# Llama 3.2 3B (poor adherence)
./llama-server --jinja -fa --verbose \
-hfr lmstudio-community/Llama-3.2-3B-Instruct-GGUF -hff Llama-3.2-3B-Instruct-Q6_K_L.gguf \
--chat-template "$( python scripts/get_hf_chat_template.py meta-llama/Llama-3.2-3B-Instruct )"

./llama-server --jinja -fa --verbose \
-m ~/Downloads/Llama-3.2-3B-Instruct-Q6_K_L.gguf \
--chat-template "$( python scripts/get_hf_chat_template.py meta-llama/Llama-3.2-3B-Instruct )"

# Llama 3.2 1B (very poor adherence)
./llama-server --jinja -fa --verbose \
-hfr lmstudio-community/Llama-3.2-1B-Instruct-GGUF -hff Llama-3.2-1B-Instruct-Q4_K_M.gguf \
Expand Down

0 comments on commit b559d64

Please sign in to comment.