Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
like
10
Follow
Red Hat AI
2.95k
Image-Text-to-Text
Safetensors
34 languages
mistral3
mistralai
mistral
mistral-small
neuralmagic
redhat
llmcompressor
quantized
W4A16
INT4
conversational
compressed-tensors
fast
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
4
Copy to bucket
new
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Sort: Recently created
Mistral small 3.2 is out
👍
3
#4 opened about 1 year ago by
zacksiri
VRAM requirement
#3 opened about 1 year ago by
Waln
Running in vLLM with tool calling support
2
#1 opened over 1 year ago by
LLukas22
zacksiri 
Waln 
LLukas22