How did you quantised this model?
1
#3 opened almost 2 years ago
by
Saksham54
4-bit quantization
#2 opened about 2 years ago
by
ibalampanis
This quant gives a terrifying output
👍🤯 3
3
#1 opened about 2 years ago
by
alexcardo