xocialize's picture
Upload transformer/quant_config.json with huggingface_hub
acfbb71 verified
Raw
History Blame Contribute Delete
195 Bytes
{
"group_size": 32,
"bits": 4,
"scope": "attn|feed_forward",
"weights_file": "transformer_int4.safetensors",
"note": "attn+ffn Linears quantized; embeds/time/norm_out/AdaLN kept bf16"
}