Hugging Face's logo

majentik
/
Mistral-Small-4-119B-RotorQuant-MLX-8bit

Text Generation
MLX
Safetensors
mistral3
rotorquant
kv-cache-quantization
mistral
Mixture of Experts
sparse-moe
multimodal
quantized
8bit
apple-silicon
256k-context
thinking
conversational
8-bit precision
Model card Files
xet
 Community
Mistral-Small-4-119B-RotorQuant-MLX-8bit / tokenizer_config.json

Commit History

Add MLX 8-bit quantized model with KV cache compression
21d6a54
verified

majentik commited on