Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,27 @@
+---
+base_model: "deepseek-ai/DeepSeek-R1-Distill-Llama-8B"
+language:
+  - en
+tags:
+  - transformers
+  - safetensors
+  - llama
+  - text-generation
+  - conversational
+  - autotrain_compatible
+  - text-generation-inference
+  - endpoints_compatible
+  - region:us
+license: "unknown"
+inference: false
+quantized_by: pbatra
+---
+
+# DeepSeek-R1-Distill-Llama-8B
+
+This repository contains quantized versions of the model from the original repository: [deepseek-ai/DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B).
+
+| Name | Quantization Method | Size (GB) |
+|------|---------------------|-----------|
+| deepseek-r1-distill-llama-8b.Q8_0.gguf | q8_0 | 7.95 |
+| deepseek-r1-distill-llama-8b.Q4_0.gguf | q4_0 | 4.34 |