LFM2-VL-1.6B-INT4-quantized / quantization_config.json

INT4 quantization of LiquidAI/LFM2-VL-1.6B (LLM backbone quantized, vision encoder fp16)

08416be verified 2 months ago

394 Bytes

	{
	"base_model": "LiquidAI/LFM2-VL-1.6B",
	"quantization": "int4_per_group_symmetric",
	"group_size": 128,
	"bits": 4,
	"method": "static_int4_dequantized",
	"description": "INT4 per-group symmetric quantization of LLM backbone weights. Vision encoder kept in fp16. Weights stored as dequantized fp16 for maximum compatibility.",
	"quantized_layers": 93,
	"skipped_vision_layers": 159
	}