Text Generation
Transformers
Safetensors
step3p5
conversational
custom_code
fp8
Tingdan jeeejeee commited on
Commit
da67aa2
·
1 Parent(s): a0634b4

Update Step-3.5-Flash vLLM recipe (#2)

Browse files

- Update Step-3.5-Flash vLLM recipe (e4d3549a39e2ce9c17148846714f5bbf203027fc)


Co-authored-by: jeejeelee <jeeejeee@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -211,6 +211,7 @@ vllm serve <MODEL_PATH_OR_HF_ID> \
211
  --speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
212
  --trust-remote-code
213
  ```
 
214
 
215
  ### 6.2 SGLang
216
 
 
211
  --speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
212
  --trust-remote-code
213
  ```
214
+ You can also refer to the [Step-3.5-Flash](https://github.com/vllm-project/recipes/blob/main/StepFun/Step-3.5-Flash.md) recipe.
215
 
216
  ### 6.2 SGLang
217