Spaces:

Samixx
/

voting-bot-llm

Sleeping

Samixx commited on Jul 25

Commit

afc0708

1 Parent(s): 6b56c00

fix: increase context size in CMD for llama-server

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -53,7 +53,7 @@ CMD ["/app/llama-server", \
      "--host", "0.0.0.0", \
      "--port", "7860", \
      "--threads", "2", \
-     "--ctx-size", "8192", \
      "-ngl", "0", \
      "--batch-size", "512", \
      "--jinja"]

      "--host", "0.0.0.0", \
      "--port", "7860", \
      "--threads", "2", \
+     "--ctx-size", "24576",
      "-ngl", "0", \
      "--batch-size", "512", \
      "--jinja"]