Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
int8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
text-generation-inference
8-bit precision
Model card Files
xet
Community
3
Meta-Llama-3.1-8B-Instruct-quantized.w8a8 / config.json

Commit History

Updated compression_config to quantization_config
f2c944e
verified

mgoin commited on

Upload folder using huggingface_hub
25b9a14
verified

alexmarques commited on