FastVLM-1.5B-PYTORCH-INT4 / quant_info.json
Azaz666's picture
Upload PyTorch INT4 quantized FastVLM-1.5B (weights + config + eval)
c2af72f
{
"base_model": "apple/FastVLM-1.5B",
"quantization": "pytorch_int4",
"bits": 4,
"method": "per-group symmetric",
"group_size": 128,
"vision_encoder": "fp16 (not quantized)"
}