Samplers, templates etc. - help, please :-D
So what do we actually do in the end to make it work?
Samplers: Temperature 1.0-1.25, Min P 0.01-0.1, DRY 0.8/1.75/2/0 DRY. All the rest - nullified. That's clear.
Context Template: ChatML? Chat ML-Names? Mistral?
Instruct: Mistral or Mistral + we need to do something in Silly Tavern in addition to selecting Mistral? Do we download your settings and use those instead because the SillyTavern ones will be wrong the way they go in a vanilla form? I don't understand how exactly it works - with your note on template from Mistral employee. I'm lost here, sorry for a bother :-P
Try this https://huggingface.co/Virt-io/SillyTavern-Presets (Mistral presets, both Context and Instruct)
Try this https://huggingface.co/Virt-io/SillyTavern-Presets (Mistral presets, both Context and Instruct)
Thank you very much. They work relatively well on Q8 but give me a complete rubbish at Q6. Any idea to why it happens? o.O
Still, great work in general.
Turn off system as user in instruct mode sequence
Turn off system as user in instruct mode sequence
You mean the system prompt? Why? If not, something else?
I mean this thingy to be turned off -
Under system prompt, in the instruct mode sequence. It hepls model not be confused and stop acting like user... most of the times.
Also, you can add a little to rep pen, something like 1,05. For me, it helps model to not fall into repetition with certan cards.
I mean this thingy -
Under system prompt, in the instruct mode sequence. It hepls model not be confused and stop acting like user... most of the times.
Oh, ok. Thx a lot!
Hey @sphiratrioth666 , I see that someone else already offered help, and I hope it works better! You can also use my recommended settings for the Story String and Instruct: https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main/Customized/Mistral%20Improved%202%20Electric%20Boogaloo
Hey @sphiratrioth666 , I see that someone else already offered help, and I hope it works better! You can also use my recommended settings for the Story String and Instruct: https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main/Customized/Mistral%20Improved%202%20Electric%20Boogaloo
Thx! I've tried both yours and Virt-io ones. Both work well :-) Thank you very much for response, you didn't have to go as far as those screenshots, much appreciated!