Hugging Face's logo

majentik
/
Leanstral-RotorQuant-MLX-8bit

Text Generation
MLX
Safetensors
mistral3
rotorquant
kv-cache-quantization
8bit
weight-quantization
leanstral
lean4
formal-proofs
theorem-proving
quantized
apple-silicon
mistral
Mixture of Experts
8-bit precision
Model card Files
xet
 Community
Leanstral-RotorQuant-MLX-8bit / generation_config.json

Commit History

Add MLX 8-bit quantized model with KV cache compression
cfb84ae
verified

majentik commited on