metadata
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct/blob/main/LICENSE
base_model: Qwen/Qwen2.5-14B-Instruct
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
EXL3 quants of Qwen2.5-14B-Instruct
2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
8.00 bits per weight / H8