Update README.md
Browse files
README.md
CHANGED
|
@@ -18,3 +18,26 @@ RKNN-Toolkit : 1.1.4
|
|
| 18 |
官方镜像版Ubuntu 22.04 5.10.110
|
| 19 |
|
| 20 |
Orange Pi5 8G
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
官方镜像版Ubuntu 22.04 5.10.110
|
| 19 |
|
| 20 |
Orange Pi5 8G
|
| 21 |
+
|
| 22 |
+
# 如何部署
|
| 23 |
+
1. 首先在本地安装git fls
|
| 24 |
+
```
|
| 25 |
+
git lfs install
|
| 26 |
+
```
|
| 27 |
+
2. clone本仓库
|
| 28 |
+
```
|
| 29 |
+
git clone https://huggingface.co/VRxiaojie/DeepSeek-R1-Distill-Qwen-1.5B-RK3588S-RKLLM1.1.4
|
| 30 |
+
```
|
| 31 |
+
3. 将模型上传到香橙派5
|
| 32 |
+
```
|
| 33 |
+
mkdir ~/rkllm && cd ~/rkllm
|
| 34 |
+
```
|
| 35 |
+
使用ADB或其他工具将`deepseek-r1-1.5B-rkllm1.1.4.rkllm` 上传至开发板的rkllm文件夹下
|
| 36 |
+
|
| 37 |
+
4. 生成llm_demo运行文件
|
| 38 |
+
参考RKLLM官方GitHub仓库文档[https://github.com/airockchip/rknn-llm/tree/main/doc](https://github.com/airockchip/rknn-llm/tree/main/doc)
|
| 39 |
+
编译生成llm_demo运行文件
|
| 40 |
+
|
| 41 |
+
或使用仓库中已编译好的文件
|
| 42 |
+
|
| 43 |
+
5. 调整提示词前后缀并启用提示词
|