zai-org
/

GLM-4.7

Text Generation

Model card Files Files and versions

zRzRzRzRzRzRzR commited on 1 day ago

Commit

26f32ad

·

1 Parent(s): 9fcd12a

readme

Files changed (1) hide show

README.md +7 -5

README.md CHANGED Viewed

@@ -161,11 +161,13 @@ print(output_text)
 ```shell
 vllm serve zai-org/GLM-4.7-FP8 \
-    --tensor-parallel-size 8 \
-    --tool-call-parser glm47 \
-    --reasoning-parser glm45 \
-    --enable-auto-tool-choice \
-    --served-model-name glm-4.7-fp8
 ```
 ### SGLang

 ```shell
 vllm serve zai-org/GLM-4.7-FP8 \
+     --tensor-parallel-size 4 \
+     --speculative-config.method mtp \
+     --speculative-config.num_speculative_tokens 1 \
+     --tool-call-parser glm47 \
+     --reasoning-parser glm45 \
+     --enable-auto-tool-choice \
+     --served-model-name glm-4.7-fp8
 ```
 ### SGLang