Duplicated from jbochi/madlad400-3b-mt
I want to use the quantized version with ctransformers, but I'm not sure what to put for the model type. Also, is there any way to do batch processing?
· Sign up or log in to comment
