| license: other | |
| license_name: modified-mit | |
| license_link: https://github.com/MiniMax-AI/MiniMax-M2.1/blob/main/LICENSE | |
| Exllama 3 quant of Minimax M2.1 | |
| Currently have 3 versions: | |
| 4.0bpw H6: | |
| - KLD: 0.10375661 | |
| - Perflexity: 7.79166165 | |
| 4.04bpw H6 (optimized quant): | |
| - KLD: 0.09264404 | |
| - Perflexity: 7.79524456 | |
| 6.0bpw H6: | |
| - KLD: 0.07343601 | |
| - Perflexity: 7.74155170 | |