| license: apache-2.0 | |
| base_model: tencent/Hy3 | |
| base_model_relation: quantized | |
| quantized_by: turboderp | |
| tags: | |
| - exl3 | |
| EXL3 quants of [Hy3](https://huggingface.co/tencent/Hy3) | |
| ⚠️ Needs ExLlamav3 v1.1.0 or later | |
| [2.52 bits per weight](https://huggingface.co/turboderp/Hy3-exl3/tree/2.52bpw) | |
| [3.05 bits per weight](https://huggingface.co/turboderp/Hy3-exl3/tree/3.05bpw) | |
| *(More bitrates, benchmarks etc. to follow, probably)* |