Update sglang info
#10
by
unsubscribe
- opened
- deployment_guide.md +3 -1
deployment_guide.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
# Intern-S1-Pro Deployment Guide
|
| 2 |
|
| 3 |
-
The Intern-S1-Pro release is a 1T parameter model stored in FP8 format. Deployment requires at least two 8-GPU H200 nodes, with either of the following configurations:
|
| 4 |
|
| 5 |
- Tensor Parallelism (TP)
|
| 6 |
- Data Parallelism (DP) + Expert Parallelism (EP)
|
|
@@ -126,6 +126,8 @@ vllm serve internlm/Intern-S1-Pro \
|
|
| 126 |
|
| 127 |
## SGLang
|
| 128 |
|
|
|
|
|
|
|
| 129 |
- Tensor Parallelism + Expert Parallelism
|
| 130 |
|
| 131 |
```bash
|
|
|
|
| 1 |
# Intern-S1-Pro Deployment Guide
|
| 2 |
|
| 3 |
+
The Intern-S1-Pro release is a 1T parameter model stored in FP8 format. Deployment requires at least **two 8-GPU H200** nodes, with either of the following configurations:
|
| 4 |
|
| 5 |
- Tensor Parallelism (TP)
|
| 6 |
- Data Parallelism (DP) + Expert Parallelism (EP)
|
|
|
|
| 126 |
|
| 127 |
## SGLang
|
| 128 |
|
| 129 |
+
You can use the docker image `lmsysorg/sglang:dev` to deploy. Refer to [using-docker](https://docs.sglang.io/get_started/install.html#method-3-using-docker) for more.
|
| 130 |
+
|
| 131 |
- Tensor Parallelism + Expert Parallelism
|
| 132 |
|
| 133 |
```bash
|