metadata
license: apache-2.0
base_model: tencent/Hy3
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
EXL3 quants of Hy3
⚠️ Needs ExLlamav3 v1.1.0 or later
2.52 bits per weight
3.05 bits per weight
(More bitrates, benchmarks etc. to follow, probably)