Could you show the benchmark loss for this quantization?
9
#4 opened about 1 month ago
by
TomLucidor
Any plans for a 6bit or 8bit version?
1
#3 opened about 2 months ago
by
zenmagnets
Can I run this with 36gb VRAM+ 192gb ram
10
#1 opened about 2 months ago
by
nimishchaudhari