Firworks commited on
Commit
b5afe44
·
verified ·
1 Parent(s): 4cc32c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ Check the original model card for information about this model.
20
 
21
  # Running the model with VLLM in Docker
22
  ```sh
23
- sudo docker run --runtime nvidia --gpus all -p 8000:8000 --ipc=host vllm/vllm-openai:nightly --model Firworks/Solar-Open-100B-nvfp4 --dtype auto --max-model-len 32768
24
  ```
25
  This was tested on an RTX Pro 6000 Blackwell cloud instance.
26
 
 
20
 
21
  # Running the model with VLLM in Docker
22
  ```sh
23
+ sudo docker run --runtime nvidia --gpus all -p 8000:8000 --ipc=host upstage/vllm-solar-open:latest --model Firworks/Solar-Open-100B-nvfp4 --dtype auto --max-model-len 32768 --trust-remote-code --enable-auto-tool-choice --tool-call-parser solar_open --reasoning-parser solar_open --logits-processors vllm.model_executor.models.parallel_tool_call_logits_processor:ParallelToolCallLogitsProcessor --logits-processors vllm.model_executor.models.solar_open_logits_processor:SolarOpenTemplateLogitsProcessor
24
  ```
25
  This was tested on an RTX Pro 6000 Blackwell cloud instance.
26