MikeRoz's picture
Update README.md
b34c3d6 verified
metadata
license: llama3.3
thumbnail: >-
  https://cdn-uploads.huggingface.co/production/uploads/6625f4a8a8d1362ebcc3851a/hIZ2ZcaDyfYLT9Yd4pfOs.jpeg
language:
  - en
base_model: ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large
base_model_relation: quantized
library_name: exllamav3
pipeline_tag: text-generation
tags:
  - exl3

exllamav3 quantizations of ArliAI's DS-R1-Distill-70B-ArliAI-RpR-v4-Large

2.25bpw h6 (20.661 GiB)
4.25bpw h6 (36.598 GiB)