MiniMax-M2.5-exl3 / README.md
MikeRoz's picture
Update README.md
468b1ba verified
metadata
pipeline_tag: text-generation
license: other
license_name: modified-mit
license_link: https://github.com/MiniMax-AI/MiniMax-M2.5/blob/main/LICENSE
library_name: exllamav3
base_model: MiniMaxAI/MiniMax-M2.5
base_model_relation: quantized
tags:
  - exl3

exllamav3 quantizations of MiniMaxAI/MiniMax-M2.5.

2.00 bpw h6 61.054 GiB
3.00 bpw h6 81.613 GiB
4.00 bpw h6 108.087 GiB
5.00 bpw h6 134.561 GiB (Uploading)

measurement.json - 2.0bpw_H6 vs 3.0bpw_H6
measurement.json - 3.0bpw_H6 vs 4.0bpw_H6