turboderp's picture
Update README.md
8bd839e verified
|
raw
history blame
1.26 kB
metadata
license: llama3.2
base_model: meta-llama/Llama-3.2-1B-Instruct
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of Llama-3.2-1B-Instruct

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

image/png