What quant would be closest to AWQ?
#5
by curiouspp8 - opened
Use to be a big AWQ user, curious how far is smol-IQ3_KS 87.237 GiB (3.277 BPW) variant.
Honestly, I'm not sure. I thought AWQ could mean multiple things depending on how it is done? Maybe a vLLM user like Phaelon (name on beaver ai club discord)... i asked him on there and maybe a reply will come here... haha