File size: 440 Bytes
f55ec7b 6d0cfa4 f55ec7b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | ---
license: apache-2.0
base_model: tencent/Hy3
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
---
EXL3 quants of [Hy3](https://huggingface.co/tencent/Hy3)
⚠️ Needs ExLlamav3 v1.1.0 or later
[2.52 bits per weight](https://huggingface.co/turboderp/Hy3-exl3/tree/2.52bpw)
[3.05 bits per weight](https://huggingface.co/turboderp/Hy3-exl3/tree/3.05bpw)
*(More bitrates, benchmarks etc. to follow, probably)* |