0.9.2
This version allows to override the chat template. This may be helpful if a model does not have a tokenizer with a chat template.
How to use:
./dllama... --chat-template llama3
./dllama-api ... --chat-template llama3
Supported values:
llama2
llama3
zephyr
chatml