File size: 383 Bytes
b9f2a40
 
 
 
 
 
 
 
8fedc18
b9f2a40
4be679c
6fffb93
 
b9f2a40
 
8fedc18
 
 
 
4be679c
2f95abc
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
---
license: other
license_name: modified-mit
license_link: https://github.com/MiniMax-AI/MiniMax-M2.1/blob/main/LICENSE
---

Exllama 3 quant of Minimax M2.1

Currently have 3 versions:

4.0bpw H6:
  - KLD: 0.10375661
  - Perflexity: 7.79166165


4.04bpw H6 (optimized quant):
  - KLD: 0.09264404
  - Perflexity: 7.79524456

6.0bpw H6:
  - KLD: 0.07343601
  - Perflexity: 7.74155170