majentik's picture
Add MLX quantized model with KV cache compression
54bef76 verified