Llama-3.2-3B-Instruct-GGUF

An unchanged copy of Llama 3.2 3B Instruct GGUF files, kept here so the WorkOffline app can download them from one place, pinned to an exact revision and checked against SHA-256.

File here Copied from Upstream revision Size (bytes) SHA-256
Llama-3.2-3B-Instruct-Q4_K_M.gguf bartowski/Llama-3.2-3B-Instruct-GGUF/Llama-3.2-3B-Instruct-Q4_K_M.gguf 5ab33fa94d1d04e903623ae72c95d1696f09f9e8 2019377696 6c1a2b41161032677be168d354123594c0e6e67d2b9227c84f296ad037c728ff

The bytes are identical to the upstream files; only the file name may differ. All credit for the model goes to its authors (meta-llama) and for the GGUF conversion to bartowski. Use of the files is governed by the original licence.

Downloads last month
61
GGUF
Model size
3B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for WorkOffline/Llama-3.2-3B-Instruct-GGUF

Quantized
(561)
this model