Hugging Face's logo

altomek
/
Llama-3.2-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
imatrix
conversational
Model card Files
xet
Community

Llama-3.2-3B-Instruct

Selected GGUF quants of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month
10
GGUF
Model size
3B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for altomek/Llama-3.2-3B-Instruct-GGUF

Base model

alpindale/Llama-3.2-3B-Instruct
Quantized
(5)
this model

Collection including altomek/Llama-3.2-3B-Instruct-GGUF