Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
like
10
Follow
Red Hat AI
1.82k
Image-Text-to-Text
Safetensors
34 languages
mistral3
mistralai
mistral
mistral-small
neuralmagic
redhat
llmcompressor
quantized
W4A16
INT4
conversational
compressed-tensors
fast
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
4
main
Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
/
generation_config.json
alexmarques
Upload folder using huggingface_hub
a98a66a
verified
9 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
116 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"transformers_version"
:
"4.52.0.dev0"
}