Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
like
5
Follow
Red Hat AI
1.75k
Image-Text-to-Text
Safetensors
34 languages
mistral3
mistralai
mistral
mistral-small
neuralmagic
redhat
llmcompressor
quantized
W8A8
conversational
compressed-tensors
fast
8-bit precision
arxiv:
2211.10438
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
3
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (2)
Sort: Recently created
能提供一下量化脚本吗
#3 opened 6 months ago by
aierwiki