blobbybob commited on
Commit
9ca90ea
·
verified ·
1 Parent(s): 830ab09

Serve command: match validated recipe (--language-model-only)

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -100,6 +100,7 @@ The repo ships vLLM-ready weights (LoRA merged, keys repacked, Qwen3.5-9B text c
100
  vllm serve ZelligeAI/tessera-preview-9b \
101
  --served-model-name tessera-preview-9b \
102
  --max-model-len 32768 --dtype bfloat16 \
 
103
  --reasoning-parser qwen3 \
104
  --enable-auto-tool-choice --tool-call-parser qwen3_coder
105
  ```
 
100
  vllm serve ZelligeAI/tessera-preview-9b \
101
  --served-model-name tessera-preview-9b \
102
  --max-model-len 32768 --dtype bfloat16 \
103
+ --language-model-only --gpu-memory-utilization 0.90 \
104
  --reasoning-parser qwen3 \
105
  --enable-auto-tool-choice --tool-call-parser qwen3_coder
106
  ```