Update Step-3.5-Flash vLLM recipe
#1
by
jeeejeee
- opened
README.md
CHANGED
|
@@ -207,6 +207,7 @@ vllm serve <MODEL_PATH_OR_HF_ID> \
|
|
| 207 |
--speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
|
| 208 |
--trust-remote-code
|
| 209 |
```
|
|
|
|
| 210 |
|
| 211 |
### 6.2 SGLang
|
| 212 |
|
|
|
|
| 207 |
--speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
|
| 208 |
--trust-remote-code
|
| 209 |
```
|
| 210 |
+
You can also refer to the [Step-3.5-Flash](https://github.com/vllm-project/recipes/blob/main/StepFun/Step-3.5-Flash.md) recipe.
|
| 211 |
|
| 212 |
### 6.2 SGLang
|
| 213 |
|