Skip to content

Commit

Permalink
Update tool_calling.md
Browse files Browse the repository at this point in the history
update tool_chat_template_llama3_json.jinja
to tool_chat_template_llama3.1_json.jinja
  • Loading branch information
Bryce1010 authored Jan 3, 2025
1 parent 07064cb commit 5c9c95b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/usage/tool_calling.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Start the server with tool calling enabled. This example uses Meta's Llama 3.1 8
vllm serve meta-llama/Llama-3.1-8B-Instruct \
--enable-auto-tool-choice \
--tool-call-parser llama3_json \
--chat-template examples/tool_chat_template_llama3_json.jinja
--chat-template examples/tool_chat_template_llama3.1_json.jinja
```

Next, make a request to the model that should result in it using the available tools:
Expand Down

0 comments on commit 5c9c95b

Please sign in to comment.