metadata
license: apache-2.0
thumbnail: >-
https://cdn-uploads.huggingface.co/production/uploads/6625f4a8a8d1362ebcc3851a/hIZ2ZcaDyfYLT9Yd4pfOs.jpeg
language:
- en
pipeline_tag: text-generation
base_model:
- ArliAI/QwQ-32B-ArliAI-RpR-v4
base_model_relation: quantized
tags:
- exl3
library_name: exllamav3
exllamav3 quantizations of ArliAI's QwQ-32B-ArliAI-RpR-v4.
2.25bpw h6 (10.201 GiB)
3.00bpw h6 (12.925 GiB)
4.00bpw h6 (16.558 GiB)
6.00bpw h6 (23.824 GiB)
8.00bpw h8 (31.271 GiB)