mbhaskar98's picture
Upload AWQ 4-bit quantization of Qwen/Qwen2.5-7B-Instruct via llm-compressor
0d9d60a verified