b4rtaz commited on
Commit
d4a7b88
·
verified ·
1 Parent(s): ece315b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -3
README.md CHANGED
@@ -1,3 +1,25 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+
5
+ This is converted [DeepSeek R1 Distill 8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) model to Distributed Llama format. The model is quantized to Q40.
6
+
7
+ ## 🚀 How to Run?
8
+
9
+ * ⏬ Download this repository.
10
+ * ⏬ Download Distributed Llama repository.
11
+ * 🔨 Build Distributed Llama:
12
+
13
+ ```
14
+ make dllama
15
+ ```
16
+
17
+ ## 🚀 Run Distributed Llama:
18
+
19
+ ```
20
+ ./dllama chat --model dllama_model_deepseek-r1-distill-llama-8b_q40.m --tokenizer dllama_tokenizer_deepseek-r1-distill-llama-8b.t --buffer-float-type q80 --nthreads 4 --max-seq-len 8192
21
+ ```
22
+
23
+ ## 🎩 License
24
+
25
+ [MIT License](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE)