Hugging Face's logo

Bopalv
/
Llama-3.2-1B-Instruct-GGUF

GGUF
imatrix
conversational
Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Llama-3.2-1B-Instruct GGUF

Q4_K_M quantized GGUF for Llama-3.2-1B-Instruct.

Model Details

  • Base Model: meta-llama/Llama-3.2-1B-Instruct
  • Quantization: Q4_K_M
  • Format: GGUF
  • Size: 770 MB

Usage 

./llama-cli -m llama3.2-1b-instruct.gguf -p "Hello"

Source

Original quantization by bartowski.

Downloads last month
101
GGUF
Model size
1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

View all variants
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support