DeepSeek-R1-Distill-Qwen-1.5B-8bit / quantize_config.json

Commit History

AutoGPTQ model for deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B: 8 bits, gr128, desc_act=False
77fe14d
verified

Jimmy1229 commited on