It's um, certainly interesting
#5
by
reddrumm
- opened
Not yet managed to have a sensible conversation with it, though (TheBloke/una-xaberius-34b-v1beta-GPTQ)
Seems all those Quants are not working, use bartowski exLlama or open a case on the GPTQ of TheBloke. Thanks
fblgit
changed discussion status to
closed
I thought that but LoneStriker/una-xaberius-34b-v1beta-8.0bpw-h8-exl2 is doing similar things
We gonna retune this one, 200K's and quant it by ourself. hahaha but the thing is funny .. what are u telling him ? LOL