Zenabius
/

Llama-3.2-1B-Instruct-exl2

8-bit precision

Model card Files Files and versions

Llama-3.2-1B-Instruct-exl2 / README.md

Zenabius's picture

Update README.md

1642f02 verified over 1 year ago

|

history blame contribute delete

243 Bytes

base_model:
  - meta-llama/Llama-3.2-1B-Instruct

EXL2 Quantizations of Llama-3.2-1B-Instruct

Using exllamav2 release 0.2.2 for quantization.

Original model: https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct

Bits 8.0, lm_head 6.0