These models are specifically quantized for CPU optimization you can use this on a docker space up to the speed of 9 token per second