Barist.1 / quant_report.json
KucLab's picture
Update quant_report.json (Barist.1 fourth-review release, checkpoint b1q)
0701e1c verified
Raw History Blame Contribute Delete
393 Bytes
{
"fp32": {
"file": "model.safetensors",
"mb": 3.62
},
"fp16": {
"file": "model_fp16.safetensors",
"mb": 1.81
},
"int8": {
"file": "model_int8.safetensors",
"mb": 0.91,
"scheme": "per-tensor symmetric",
"max_rel_roundtrip_error": 0.0039370302110910416,
"loader": "censer.load_state_dict_any(dir) dequantizes .q/.scale; or use --prefer-quant"
}
}