Update Step-3.5-Flash vLLM recipe (#2)
Browse files- Update Step-3.5-Flash vLLM recipe (e4d3549a39e2ce9c17148846714f5bbf203027fc)
Co-authored-by: jeejeelee <jeeejeee@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -211,6 +211,7 @@ vllm serve <MODEL_PATH_OR_HF_ID> \
|
|
| 211 |
--speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
|
| 212 |
--trust-remote-code
|
| 213 |
```
|
|
|
|
| 214 |
|
| 215 |
### 6.2 SGLang
|
| 216 |
|
|
|
|
| 211 |
--speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
|
| 212 |
--trust-remote-code
|
| 213 |
```
|
| 214 |
+
You can also refer to the [Step-3.5-Flash](https://github.com/vllm-project/recipes/blob/main/StepFun/Step-3.5-Flash.md) recipe.
|
| 215 |
|
| 216 |
### 6.2 SGLang
|
| 217 |
|