Serve command: match validated recipe (--language-model-only)
Browse files
README.md
CHANGED
|
@@ -100,6 +100,7 @@ The repo ships vLLM-ready weights (LoRA merged, keys repacked, Qwen3.5-9B text c
|
|
| 100 |
vllm serve ZelligeAI/tessera-preview-9b \
|
| 101 |
--served-model-name tessera-preview-9b \
|
| 102 |
--max-model-len 32768 --dtype bfloat16 \
|
|
|
|
| 103 |
--reasoning-parser qwen3 \
|
| 104 |
--enable-auto-tool-choice --tool-call-parser qwen3_coder
|
| 105 |
```
|
|
|
|
| 100 |
vllm serve ZelligeAI/tessera-preview-9b \
|
| 101 |
--served-model-name tessera-preview-9b \
|
| 102 |
--max-model-len 32768 --dtype bfloat16 \
|
| 103 |
+
--language-model-only --gpu-memory-utilization 0.90 \
|
| 104 |
--reasoning-parser qwen3 \
|
| 105 |
--enable-auto-tool-choice --tool-call-parser qwen3_coder
|
| 106 |
```
|