Update README.md
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ Check the original model card for information about this model.
|
|
| 20 |
|
| 21 |
# Running the model with VLLM in Docker
|
| 22 |
```sh
|
| 23 |
-
sudo docker run --runtime nvidia --gpus all -p 8000:8000 --ipc=host
|
| 24 |
```
|
| 25 |
This was tested on an RTX Pro 6000 Blackwell cloud instance.
|
| 26 |
|
|
|
|
| 20 |
|
| 21 |
# Running the model with VLLM in Docker
|
| 22 |
```sh
|
| 23 |
+
sudo docker run --runtime nvidia --gpus all -p 8000:8000 --ipc=host upstage/vllm-solar-open:latest --model Firworks/Solar-Open-100B-nvfp4 --dtype auto --max-model-len 32768 --trust-remote-code --enable-auto-tool-choice --tool-call-parser solar_open --reasoning-parser solar_open --logits-processors vllm.model_executor.models.parallel_tool_call_logits_processor:ParallelToolCallLogitsProcessor --logits-processors vllm.model_executor.models.solar_open_logits_processor:SolarOpenTemplateLogitsProcessor
|
| 24 |
```
|
| 25 |
This was tested on an RTX Pro 6000 Blackwell cloud instance.
|
| 26 |
|