Thanks for providing a gguf version
#1
by simonko912 - opened
Thanks for providing a GGUF version, may I ask if you seen a issue in the model i sometimes have with setting up the temp (I used pytorch without temp / sampling for the best, acurate and not off topic responces) , also i want to say i will add your GGUF model link to my models readme.
Thanks again
sorry for my bad english
Hello again, i want to say it would be great if you could include that the model works best with this format
User: What is a cat Assistant:
But it still works without it, also i figured out temp above 0.05 (0.01 or 0.02 recomended) makes it say off topic things. it would be great if you could include that in the readme too.