Step-3.7-Flash-exl3 / README.md
turboderp's picture
Update README.md
1c2dd15 verified
|
Raw
History Blame Contribute Delete
837 Bytes
metadata
license: apache-2.0
base_model: stepfun-ai/Step-3.7-Flash
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of Step-3.7-Flash

⚠️ Requires ExLlamaV3 v0.0.39

2.52 bits per weight
2.77 bits per weight
3.05 bits per weight
3.52 bits per weight
4.05 bits per weight

kld