I'm not seeing the think tags
I don't know much about what I'm doing and this sounded pretty interesting. I'm using a gguf file quantization inside koboldcpp and the perhaps I need to configure koboldcpp correctly. The "Thinking / Reasoning Tag" settings I believe are turned on. Do you have to prompt the model to use tags?
Try this one:
First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input. Your thinking process must follow the template below:
[Put think Start tag here]Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response. Use the same language as the input.[Put think End tag here]
Here, provide a self-contained response.