vllm-server / Dockerfile
intagliated's picture
Create Dockerfile
90ad48c verified
Raw
History Blame Contribute Delete
157 Bytes
FROM vllm/vllm-openai:latest
ENV MODEL_NAME=Qwen/Qwen2.5-1.5B-Instruct
CMD ["--model", "Qwen/Qwen2.5-1.5B-Instruct", "--host", "0.0.0.0", "--port", "7860"]