majentik's picture
Add MLX quantized model with KV cache compression
f87ab8d verified