Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
like
10
Follow
Red Hat AI
2.32k
Image-Text-to-Text
Safetensors
34 languages
mistral3
mistralai
mistral
mistral-small
neuralmagic
redhat
llmcompressor
quantized
W4A16
INT4
conversational
compressed-tensors
fast
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
4
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Sort: Recently created
Mistral small 3.2 is out
👍
3
#4 opened 10 months ago by
zacksiri
VRAM requirement
#3 opened 11 months ago by
Waln
Running in vLLM with tool calling support
2
#1 opened about 1 year ago by
LLukas22