Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,10 @@ tags:
|
|
| 13 |
|
| 14 |
# DeepSeek-R1-Distill-Llama-8B-NexaQuant
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
## Background + Overview
|
| 17 |
|
| 18 |
DeepSeek-R1 has been making headlines for rivaling OpenAI’s O1 reasoning model while remaining fully open-source. Many users want to run it locally to ensure data privacy, reduce latency, and maintain offline access. However, fitting such a large model onto personal devices typically requires quantization (e.g. Q4_K_M), which often sacrifices accuracy (up to ~22% accuracy loss) and undermines the benefits of the local reasoning model.
|
|
|
|
| 13 |
|
| 14 |
# DeepSeek-R1-Distill-Llama-8B-NexaQuant
|
| 15 |
|
| 16 |
+
<div align="center">
|
| 17 |
+
<img src="banner.png" width="50%" alt="NexaQuant" />
|
| 18 |
+
</div>
|
| 19 |
+
|
| 20 |
## Background + Overview
|
| 21 |
|
| 22 |
DeepSeek-R1 has been making headlines for rivaling OpenAI’s O1 reasoning model while remaining fully open-source. Many users want to run it locally to ensure data privacy, reduce latency, and maintain offline access. However, fitting such a large model onto personal devices typically requires quantization (e.g. Q4_K_M), which often sacrifices accuracy (up to ~22% accuracy loss) and undermines the benefits of the local reasoning model.
|