Quantized AI Models Collection These models are specifically quantized for CPU optimization you can use this on a docker space up to the speed of 9 token per second • 1 item • Updated 3 days ago