Hugging Face's logo

kosbu
/
Llama-3.3-70B-Instruct-AWQ

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
awq
conversational
text-generation-inference
4-bit precision
Model card Files
xet
 Community
2

Llama-3.3-70B-Instruct AWQ 4-Bit Quantized Version

This repository provides the AWQ 4-bit quantized version of meta-llama/Llama-3.3-70B-Instruct, originally developed by Meta AI.

Downloads last month
486,827
Safetensors
Model size
71B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kosbu/Llama-3.3-70B-Instruct-AWQ

Base model

meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct
Quantized
(138)
this model

Space using kosbu/Llama-3.3-70B-Instruct-AWQ 1