Hugging Face's logo

Spaces:
muryshev
/
llama-cpp-server-70b
Runtime error

App Files Community
muryshev commited on
Commit
405056e
·
1 Parent(s): f2a6212

Update Dockerfile

Browse files
Files changed (1) hide show
  1. Dockerfile +1 -1
Dockerfile CHANGED
@@ -39,4 +39,4 @@ COPY --from=build /data/model.gguf /data/model.gguf
39
  WORKDIR /app
40
  EXPOSE 7860
41
 
42
- CMD ./server -m /data/model.gguf -c 4096 --port 7860 --host 0.0.0.0
 
39
  WORKDIR /app
40
  EXPOSE 7860
41
 
42
+ CMD ./server -m /data/model.gguf -c 4096 -ngl 70 --port 7860 --host 0.0.0.0