MiniMax-M2.1-exl3 / README.md
remichu's picture
Update README.md
2f95abc verified
metadata
license: other
license_name: modified-mit
license_link: https://github.com/MiniMax-AI/MiniMax-M2.1/blob/main/LICENSE

Exllama 3 quant of Minimax M2.1

Currently have 3 versions:

4.0bpw H6:

  • KLD: 0.10375661
  • Perflexity: 7.79166165

4.04bpw H6 (optimized quant):

  • KLD: 0.09264404
  • Perflexity: 7.79524456

6.0bpw H6:

  • KLD: 0.07343601
  • Perflexity: 7.74155170