|
|
--- |
|
|
license: llama3.3 |
|
|
thumbnail: https://cdn-uploads.huggingface.co/production/uploads/6625f4a8a8d1362ebcc3851a/hIZ2ZcaDyfYLT9Yd4pfOs.jpeg |
|
|
language: |
|
|
- en |
|
|
base_model: ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large |
|
|
base_model_relation: quantized |
|
|
library_name: exllamav3 |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- exl3 |
|
|
--- |
|
|
exllamav3 quantizations of ArliAI's [DS-R1-Distill-70B-ArliAI-RpR-v4-Large](https://huggingface.co/ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large) |
|
|
|
|
|
[2.25bpw h6](https://huggingface.co/MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3/tree/2.25bpw_H6) (20.661 GiB) |
|
|
[4.25bpw h6](https://huggingface.co/MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3/tree/4.25bpw_H6) (36.598 GiB) |
