Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Llama-3.3-70B-Instruct-quantized.w8a8
like
13
Follow
Red Hat AI
1.86k
Text Generation
Safetensors
8 languages
llama
facebook
meta
llama-3
int8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
8-bit precision
License:
llama3.3
Model card
Files
Files and versions
xet
Community
2
w4a16 variants?
#1
by
cpwan9086
- opened
Feb 28, 2025
Discussion
cpwan9086
Feb 28, 2025
Are there anything special about the w4a16 variants?
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
