Hugging Face's logo

altomek
/
Llama-3.2-3B-Instruct-8bpw-EXL2

Text Generation
Transformers
Safetensors
PyTorch
llama
facebook
meta
llama-3
conversational
text-generation-inference
8-bit precision
exl2
Model card Files
xet
 Community

Llama-3.2-3B-Instruct

ExLlamav2 8 bpw quant of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month
12
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for altomek/Llama-3.2-3B-Instruct-8bpw-EXL2

Base model

alpindale/Llama-3.2-3B-Instruct
Quantized
(5)
this model