iMatrix GGUFs for Qwen 1.5 32B Chat - https://huggingface.co/Qwen/Qwen1.5-32B-Chat
For standard Q_K quants, see their official repo: https://huggingface.co/Qwen/Qwen1.5-32B-Chat-GGUF
iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt
FP16 GGUF also included, as the official repo lacks it. This been split with peazip due to file size limits.
Recombine with peazip, 7zip, or simple concatenate command.
- Downloads last month
- 4
Hardware compatibility
Log In
to add your hardware
We're not able to determine the quantization variants.