Ovis2-4B-PYTORCH-INT4 / quant_meta.json
Azaz666's picture
Upload PyTorch-INT4 quantized model
208d006 verified
raw
history blame contribute delete
220 Bytes
{
"model_id": "AIDC-AI/Ovis2-4B",
"family": "ovis2",
"method": "pytorch_int4_custom",
"bits": 4,
"group_size": 128,
"skip_vision": true,
"n_quantized": 253,
"cpu_load_time_s": 6.1,
"quant_time_s": 2.2
}