llama-cpp-server-70b

Runtime error

muryshev commited on Dec 25, 2023

Commit

93ebe0e

1 Parent(s): dcca087

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -21,7 +21,7 @@ ENV LLAMA_CUBLAS=1
 RUN mkdir build && \
     cd build && \
-    cmake .. #-DLLAMA_CUBLAS=ON && \
     cmake .. && \
     cmake --build . --config Release

 RUN mkdir build && \
     cd build && \
+    cmake .. -DLLAMA_CUBLAS=ON && \
     cmake .. && \
     cmake --build . --config Release