Hugging Face's logo

Sherstnev
/
llama-30b-awq-w4

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Model card Files
xet
 Community
1

This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.

Downloads last month
296
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support