gemma-4-31B-it-AutoRound-AWQ / quantization_config.json
mattbucci's picture
Gemma 4 31B AWQ: AutoRound GPTQ→AWQ converted, full dequant→requant for symmetric scales
caa0b8e verified
Raw
History Blame Contribute Delete
241 Bytes
{
"bits": 4,
"data_type": "int",
"group_size": 128,
"sym": true,
"autoround_version": "0.13.0",
"block_name_to_quantize": "model.language_model.layers",
"quant_method": "auto-round",
"packing_format": "auto_round:auto_gptq"
}