Request

#1
by warry - opened

Could you perform INT8/INT4 quantization on the base model?
Thanks!

Sign up or log in to comment