Ovis2-4B-torchao-W4A8 / quant_meta.json
Azaz666's picture
Upload torchao-W4A8 quantized model
690678d verified
Raw
History Blame Contribute Delete
278 Bytes
{
"model_id": "AIDC-AI/Ovis2-4B",
"family": "ovis2",
"method": "torchao_w4a8",
"bits_weight": 4,
"bits_activation": 8,
"group_size": 128,
"skip_vision": true,
"load_time_s": 6.1,
"quant_time_s": 0.2,
"quant_method": "Int8DynamicActivationInt4Weight (W4A8)"
}