zRzRzRzRzRzRzR
commited on
Commit
·
69f9dbb
1
Parent(s):
5e400dd
sglang update
Browse files
README.md
CHANGED
|
@@ -135,6 +135,8 @@ vLLM, SGLang, and xLLM all support local deployment of GLM-5. A simple deploymen
|
|
| 135 |
--mem-fraction-static 0.85 \
|
| 136 |
--served-model-name glm-5-fp8
|
| 137 |
```
|
|
|
|
|
|
|
| 138 |
|
| 139 |
+ xLLM and other Ascend NPU
|
| 140 |
|
|
|
|
| 135 |
--mem-fraction-static 0.85 \
|
| 136 |
--served-model-name glm-5-fp8
|
| 137 |
```
|
| 138 |
+
|
| 139 |
+
Check the [sglang cookbook](https://cookbook.sglang.io/autoregressive/GLM/GLM-5) for more details.
|
| 140 |
|
| 141 |
+ xLLM and other Ascend NPU
|
| 142 |
|