Spaces:

ramedde
/

test

Sleeping

ramedde commited on May 26

Commit

14cd052

verified ·

1 Parent(s): 226caaa

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -23,9 +23,8 @@ server = subprocess.Popen([
     "-c", "5096",
     "-t", "4",
     "--host", "0.0.0.0",
-    "--port", "8080",
-    "--no-mmap",
-    "--cache-ram", "0",   # disable prompt cache — prevents slowdown on repeated runs
 ])
 print("Starting llama-server, waiting 8 seconds...")

     "-c", "5096",
     "-t", "4",
     "--host", "0.0.0.0",
+    "--port", "8080"
+       # disable prompt cache — prevents slowdown on repeated runs
 ])
 print("Starting llama-server, waiting 8 seconds...")