Hugging Face's logo

RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text
Safetensors
mistral3
mistralai
mistral
mistral-small
neuralmagic
redhat
llmcompressor
quantized
W4A16
INT4
conversational
compressed-tensors
fast
Model card Files
xet
 Community
4
New discussion

Mistral small 3.2 is out

👍 3
#4 opened 10 months ago by
zacksiri

VRAM requirement
#3 opened 11 months ago by
Waln

Running in vLLM with tool calling support

2
#1 opened about 1 year ago by
LLukas22