Update README.md
Browse files
README.md
CHANGED
|
@@ -198,6 +198,8 @@ lmdeploy serve api_server ./workspace \
|
|
| 198 |
|
| 199 |
In the above parameters, `server_name` and `server_port` indicate the service address and port, respectively. The `tp` parameter, as mentioned earlier, stands for Tensor Parallelism. The remaining parameter, instance_num, represents the number of instances and can be understood as the batch size. After execution, it will appear as shown below.
|
| 200 |
|
|
|
|
|
|
|
| 201 |
## Web Service Startup Method 1:
|
| 202 |
|
| 203 |
### Starting the Service with Gradio
|
|
|
|
| 198 |
|
| 199 |
In the above parameters, `server_name` and `server_port` indicate the service address and port, respectively. The `tp` parameter, as mentioned earlier, stands for Tensor Parallelism. The remaining parameter, instance_num, represents the number of instances and can be understood as the batch size. After execution, it will appear as shown below.
|
| 200 |
|
| 201 |
+
After this, users can start the Web Service as described in [Web Service Startup Method 1](## Web Service Startup Method 1:)
|
| 202 |
+
|
| 203 |
## Web Service Startup Method 1:
|
| 204 |
|
| 205 |
### Starting the Service with Gradio
|