Firworks commited on
Commit
651495c
·
verified ·
1 Parent(s): 4aab120

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ Check the original model card for information about this model.
20
 
21
  # Running the model with VLLM in Docker
22
  ```sh
23
- sudo docker run --runtime nvidia --gpus all -p 8000:8000 --ipc=host vllm/vllm-openai:nightly --model Firworks/Hemlock-Coder-7B-nvfp4 --dtype auto --max-model-len 32768
24
  ```
25
  This was tested on an RTX Pro 6000 Blackwell cloud instance.
26
 
 
20
 
21
  # Running the model with VLLM in Docker
22
  ```sh
23
+ sudo docker run --runtime nvidia --gpus all -p 8000:8000 --ipc=host vllm/vllm-openai:latest Firworks/Hemlock-Coder-7B-nvfp4 --dtype auto --max-model-len 32768
24
  ```
25
  This was tested on an RTX Pro 6000 Blackwell cloud instance.
26