---
license: apache-2.0
base_model: tencent/Hy3
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
---

EXL3 quants of [Hy3](https://huggingface.co/tencent/Hy3)

⚠️ Needs ExLlamav3 v1.1.0 or later

[2.52 bits per weight](https://huggingface.co/turboderp/Hy3-exl3/tree/2.52bpw)    
[3.05 bits per weight](https://huggingface.co/turboderp/Hy3-exl3/tree/3.05bpw)    

*(More bitrates, benchmarks etc. to follow, probably)*