why this quant still not ready?
#1
by Svatosalav - opened
gemma 26b quant works great. please make this qwen 27b quant, as I have 12gb vram and it's impossible to use the original, and 35b is incredibly dumb and constantly loops. also, if you can, make an uncensored version of this quant