Hugging Face's logo

Lowkey-Loki
/
Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-3bit

Text Generation
MLX
Safetensors
mistral
3bit
conversational
3-bit
Model card Files
xet
 Community

Quantized 3bit MLX text-only version

NOTE: This is a text-only version of the official https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503 converted to HF format by https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF

Downloads last month
15
Safetensors
Model size
3B params
Tensor type
F16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

3-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-3bit

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Mistral-Small-3.1-24B-Instruct-2503
Quantized
(60)
this model