phi-2-gptq-4bit / quantize_manifest.json
Crusadersk's picture
Self-quantized phi-2-gptq 4-bit (group_size=128, seed=42)
4d7ab2b verified
{
"model_name": "phi-2",
"hf_id": "microsoft/phi-2",
"method": "gptq",
"bits": 4,
"group_size": 128,
"calibration_dataset": "allenai/c4",
"calibration_samples": 128,
"seed": 42,
"elapsed_s": 690.9595537185669,
"tool": "gptqmodel"
}