Update README.md
Browse files
README.md
CHANGED
|
@@ -37,13 +37,13 @@ You need to download the .gguf model first
|
|
| 37 |
If you want to use the cpu install these dependencies:
|
| 38 |
|
| 39 |
```python
|
| 40 |
-
pip install llama-cpp-python
|
| 41 |
```
|
| 42 |
|
| 43 |
If you want to use the gpu instead:
|
| 44 |
|
| 45 |
```python
|
| 46 |
-
CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install
|
| 47 |
```
|
| 48 |
|
| 49 |
And then use this code to see a response to the prompt.
|
|
|
|
| 37 |
If you want to use the cpu install these dependencies:
|
| 38 |
|
| 39 |
```python
|
| 40 |
+
pip install llama-cpp-python huggingface_hub
|
| 41 |
```
|
| 42 |
|
| 43 |
If you want to use the gpu instead:
|
| 44 |
|
| 45 |
```python
|
| 46 |
+
CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install huggingface_hub llama-cpp-python --force-reinstall --upgrade --no-cache-dir
|
| 47 |
```
|
| 48 |
|
| 49 |
And then use this code to see a response to the prompt.
|