vllm / quant_config.json
Madhan-Alagarsamy's picture
Update quant_config.json
6309974 verified
{
"quant_method": "modelopt",
"producer": { "name": "modelopt" },
"__class__": "fake_quantizer.FakeQuantizer"
}