Install nvidia-cuda-runtime-cu12 + nvidia-cublas-cu12 so libllama.so finds libcudart/libcublas
Browse files- requirements.txt +2 -0
requirements.txt
CHANGED
|
@@ -1,3 +1,5 @@
|
|
| 1 |
--extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu124
|
| 2 |
huggingface_hub>=0.25.0
|
| 3 |
llama-cpp-python>=0.3.1
|
|
|
|
|
|
|
|
|
| 1 |
--extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu124
|
| 2 |
huggingface_hub>=0.25.0
|
| 3 |
llama-cpp-python>=0.3.1
|
| 4 |
+
nvidia-cuda-runtime-cu12
|
| 5 |
+
nvidia-cublas-cu12
|