MiniMax-H3-MLX-8bit / quant_config.json
pipenetwork's picture
Upload folder using huggingface_hub
3ac5208 verified
Raw
History Blame Contribute Delete
185 Bytes
{
"bits": 8,
"group_size": 64,
"quantize_adaln": true,
"adaln_bits": 8,
"quantized_layers": {
"8": 258
},
"gb_on_disk": 35.3,
"gb_resident_after_adaln_drop": 21.47
}