Nothing but symbols out

#1
by Reithan - opened

Tried 3 different quants from MrAdermacher, i1-Q4-K_S and K_M, as well as Q4_K_S. All produce nothing but gibberish. I tried several different input formats and tokenizers, with several presets, but no dice.
image.png

I have exactly the same problem, I tried all sorts of settings, but nothing. I thought there was something wrong with me and I just didn't know how to do anything.

Have you solve this? Or this model is broken?

forget it and get another model, why try to fix it?

Sign up or log in to comment