Character's thoughts inside <think> tags instead of LLM's reflection

#3
by Ubr - opened

The DeepSeek R1 models usually reflect inside the <think> tags how to create a perfect character reply. Vulpecula-R1 instead shows the character's thoughts inside the <think> tags. Is this intended behavior or am I prompting it wrongly?

Owner
β€’
edited Mar 28

I've been mainly using LeCeption by Steelskull with thinking:

https://huggingface.co/Steelskull/L3.3-Electra-R1-70b/blob/main/LeCeption-XML-V2.json

And the Euryale v2.1 Prompt without thinking:

https://huggingface.co/Sao10K/L3-70B-Euryale-v2.1/blob/main/Euryale-v2.1-Llama-3-Instruct.json

Unfortunately can't really help you much, I spent a few hours testing and never ran into that issue on my own.

I tried LeCeption in the exact version you provided. And if I add the <think> prefix in SillyTaver, the replies will contain <think> content with the characters thoughts. Do you actually get narrator thoughts inside the <think> tags in your setup?

Sign up or log in to comment