GGUF
#1
by amogusgaysex - opened
Please any gguf version ? I tried doing it myself but i keep getting broken replies
amogusgaysex changed discussion status to closed
Try this:- QuantFactory/Meditron3-Gemma2-2B-GGUF
Still very broken for some reason
Tested q8 and q6 in llama.cpp and pocketpal (android), same schizo results every time
amogusgaysex changed discussion status to open