---
license: llama3.3
thumbnail: https://cdn-uploads.huggingface.co/production/uploads/6625f4a8a8d1362ebcc3851a/hIZ2ZcaDyfYLT9Yd4pfOs.jpeg
language:
- en
base_model: ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large
base_model_relation: quantized
library_name: exllamav3
pipeline_tag: text-generation
tags:
  - exl3
---
exllamav3 quantizations of ArliAI's [DS-R1-Distill-70B-ArliAI-RpR-v4-Large](https://huggingface.co/ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large)

[2.25bpw h6](https://huggingface.co/MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3/tree/2.25bpw_H6) (20.661 GiB)    
[4.25bpw h6](https://huggingface.co/MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3/tree/4.25bpw_H6) (36.598 GiB)