Hugging Face's logo

majentik
/
Mistral-Small-4-119B-RotorQuant-MLX-2bit

Text Generation
MLX
Safetensors
mistral3
rotorquant
kv-cache-quantization
mistral
Mixture of Experts
sparse-moe
multimodal
quantized
2-bit
apple-silicon
256k-context
thinking
conversational
Model card Files
xet
 Community
Mistral-Small-4-119B-RotorQuant-MLX-2bit

Commit History

Add MLX quantized model weights
ba08f9e
verified

majentik commited on

Add model card (weights pending mlx_lm mistral3 architecture support)
4b447bf
verified

majentik commited on

initial commit
d3d7ddb
verified

majentik commited on