MiniMax-H3-MLX-4bit / quant_config.json
pipenetwork's picture
Upload folder using huggingface_hub
ca27876 verified
Raw
History Blame Contribute Delete
199 Bytes
{
"bits": 4,
"group_size": 64,
"quantize_adaln": true,
"adaln_bits": 8,
"quantized_layers": {
"4": 208,
"8": 50
},
"gb_on_disk": 25.28,
"gb_resident_after_adaln_drop": 11.45
}