Disable thinking?
#4
by
JankyMudFart
- opened
Thanks very much for this quick GGUF release!
I would just like to know if there is a quick switch like /no_think to disable thinking?
Edit, actually you can as a user pointed out: --jinja --chat-template-kwargs "{"enable_thinking": false}"
To turn it off entirely:
--jinja --chat-template-kwargs "{"enable_thinking": false}"
for llama.cpp, handle the quotes correctly . --jinja --chat-template-kwargs '{"enable_thinking": false}'