SillyTavern Sampler setting recommendation ?
#1
by
cosmiccabo
- opened
Hi. This is my first time using a Cydonia model. Googling didn't give me any definitive sampler setting recommendation so I figured I should ask the man himself. Thanks in advance !
I can suggest the following, which works well for me:
Dynamic temperature: from 0.5 to 0.7 and exp=1.4
Top P: 0.9
Min P: 0.02
xtc_threshold=0.1 and xtc_probability=0.5
Everything else is turned off.
An additional system hint taken from the Magistral model and slightly modified:
First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input.
Your thinking process must follow the template below:<think>
Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response. Don't forget to double-check your thoughts and actions, adhering to logic and structured thinking. Use the same language as the input.
</think>
Here, provide a self-contained response.