jais quantization
#1
by Jmyuse - opened
Great job! And how did you quantize the jais to 4-bit?
Hey thanks! I hope that it's working with you.
I used BitsandBytes on a 24GB A5000 GPU.
Great job! And how did you quantize the jais to 4-bit?
Hey thanks! I hope that it's working with you.
I used BitsandBytes on a 24GB A5000 GPU.