Update README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,23 @@
|
|
| 28 |
|
| 29 |
Install the dependencies required for the web demo
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
```bash
|
| 32 |
pip install streamlit==1.24.0
|
| 33 |
```
|
|
|
|
| 28 |
|
| 29 |
Install the dependencies required for the web demo
|
| 30 |
|
| 31 |
+
lmdeploy 没有安装,我们接下来手动安装一下,建议安装最新的稳定版。
|
| 32 |
+
如果是在 InternStudio 开发环境,需要先运行下面的命令,否则会报错。
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
```bash
|
| 36 |
+
# 解决 ModuleNotFoundError: No module named 'packaging' 问题
|
| 37 |
+
pip install packaging
|
| 38 |
+
# 使用 flash_attn 的预编译包解决安装过慢问题
|
| 39 |
+
pip install /root/share/wheels/flash_attn-2.4.2+cu118torch2.0cxx11abiTRUE-cp310-cp310-linux_x86_64.whl
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
```bash
|
| 43 |
+
pip install 'lmdeploy[all]==v0.4.2'
|
| 44 |
+
```
|
| 45 |
+
由于默认安装的是 runtime 依赖包,但是我们这里还需要部署和量化,所以,这里选择 `[all]`。
|
| 46 |
+
|
| 47 |
+
|
| 48 |
```bash
|
| 49 |
pip install streamlit==1.24.0
|
| 50 |
```
|