How do you use the new grammar templates in the web ui? #4109
-
|
I'm curious about implementing the new grammar feature but can't find how to pick a grammar to use in the web ui. Where are these settings located? Thanks. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
|
For others who are curious, I found it under Parameters but only when llamacpp is the loader. |
Beta Was this translation helpful? Give feedback.
-
|
I'd like to know as well. |
Beta Was this translation helpful? Give feedback.
-
|
I searched half a day for an easy implementation of grammar. Thanks! This works :) |
Beta Was this translation helpful? Give feedback.
For others who are curious, I found it under Parameters but only when llamacpp is the loader.