Add SGLang serving instructions

#3
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -76,6 +76,7 @@ Intern-S2-Mobius can be deployed using any of the following LLM inference framew
76
  - LMDeploy
77
  - Transformers
78
  - vLLM
 
79
 
80
  ### Sampling Parameters
81
 
@@ -192,5 +193,32 @@ vllm serve \
192
  --tool-call-parser qwen3_coder
193
  ```
194
 
 
195
 
 
196
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76
  - LMDeploy
77
  - Transformers
78
  - vLLM
79
+ - SGLang
80
 
81
  ### Sampling Parameters
82
 
 
193
  --tool-call-parser qwen3_coder
194
  ```
195
 
196
+ ### SGLang
197
 
198
+ Use the `lmsysorg/sglang:dev` Docker image or a recent source build with Intern-S2-Mobius support. See the [SGLang cookbook](https://docs.sglang.io/cookbook/autoregressive/InternLM/Intern-S2-Mobius) for Docker commands, verified deployment recipes, benchmarks, and usage examples.
199
 
200
+ - Serving With MTP (Recommended)
201
+
202
+ ```bash
203
+ sglang serve \
204
+ --model-path internlm/Intern-S2-Mobius \
205
+ --trust-remote-code \
206
+ --tp 2 \
207
+ --reasoning-parser qwen3 \
208
+ --tool-call-parser qwen3_coder \
209
+ --speculative-algorithm NEXTN \
210
+ --speculative-num-steps 3 \
211
+ --speculative-eagle-topk 1 \
212
+ --speculative-num-draft-tokens 4
213
+ ```
214
+
215
+ - Basic Serving Without MTP
216
+
217
+ ```bash
218
+ sglang serve \
219
+ --model-path internlm/Intern-S2-Mobius \
220
+ --trust-remote-code \
221
+ --tp 2 \
222
+ --reasoning-parser qwen3 \
223
+ --tool-call-parser qwen3_coder
224
+ ```