Hugging Face's logo

Spaces:
binary1ne
/
vllm-llama2
Paused

App Files Community
binary1ne commited on
Commit
9fd8915
·
verified ·
1 Parent(s): bbc0db7

Update Dockerfile

Browse files
Files changed (1) hide show
  1. Dockerfile +1 -1
Dockerfile CHANGED
@@ -14,4 +14,4 @@ RUN pip list
14
 
15
  RUN vllm -v
16
 
17
- CMD ["vllm", "serve","--model", "unsloth/Llama-3.2-3B-bnb-4bit"]
 
14
 
15
  RUN vllm -v
16
 
17
+ CMD ["vllm", "serve", "unsloth/Llama-3.2-3B-bnb-4bit", "--host", "0.0.0.0", "--port", "7860", "--trust-remote-code", "--device", "cpu"]