Update README.md
Browse files
README.md
CHANGED
|
@@ -482,7 +482,7 @@ Many repositories now support fine-tuning of the InternVL series models, includi
|
|
| 482 |
|
| 483 |
### LMDeploy
|
| 484 |
|
| 485 |
-
LMDeploy is a toolkit for compressing, deploying, and serving
|
| 486 |
|
| 487 |
```sh
|
| 488 |
pip install lmdeploy>=0.5.3
|
|
@@ -574,7 +574,7 @@ print(sess.response.text)
|
|
| 574 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 575 |
|
| 576 |
```shell
|
| 577 |
-
lmdeploy serve api_server OpenGVLab/InternVL2-40B --
|
| 578 |
```
|
| 579 |
|
| 580 |
To use the OpenAI-style interface, you need to install OpenAI:
|
|
|
|
| 482 |
|
| 483 |
### LMDeploy
|
| 484 |
|
| 485 |
+
LMDeploy is a toolkit for compressing, deploying, and serving LLMs & VLMs.
|
| 486 |
|
| 487 |
```sh
|
| 488 |
pip install lmdeploy>=0.5.3
|
|
|
|
| 574 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 575 |
|
| 576 |
```shell
|
| 577 |
+
lmdeploy serve api_server OpenGVLab/InternVL2-40B --server-port 23333 --tp 2
|
| 578 |
```
|
| 579 |
|
| 580 |
To use the OpenAI-style interface, you need to install OpenAI:
|