Spaces:

Yakova
/

scrambleasdasd

Sleeping

Yakova commited on May 15, 2025

Commit

30369d0

verified ·

1 Parent(s): 9c7012c

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -55,7 +55,7 @@ RUN git clone https://github.com/ggerganov/llama.cpp.git /app/llama.cpp && \
 ENV PYTHONUNBUFFERED=1 \
     ORPHEUS_MODEL_NAME=Orpheus-3b-FT-Q4_K_M.gguf \
     ORPHEUS_MAX_TOKENS=512 \
-    LLAMA_CPU_THREADS=16 \
     USE_GPU=false \
     HF_HOME=/tmp/cache \
     MODEL_NAME=Orpheus-3b-FT-Q4_K_M.gguf \

 ENV PYTHONUNBUFFERED=1 \
     ORPHEUS_MODEL_NAME=Orpheus-3b-FT-Q4_K_M.gguf \
     ORPHEUS_MAX_TOKENS=512 \
+    LLAMA_CPU_THREADS=10 \
     USE_GPU=false \
     HF_HOME=/tmp/cache \
     MODEL_NAME=Orpheus-3b-FT-Q4_K_M.gguf \