Update README.md
Browse files
README.md
CHANGED
|
@@ -68,7 +68,15 @@ And after it, add:
|
|
| 68 |
pip install einops
|
| 69 |
```
|
| 70 |
|
| 71 |
-
4.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
## How to download and use this model in text-generation-webui
|
| 74 |
|
|
|
|
| 68 |
pip install einops
|
| 69 |
```
|
| 70 |
|
| 71 |
+
4. Install the latest AutoGPTQ and compile from source - note that this requires compiling the CUDA kernel, which requires CUDA toolkit. This may be an issue for Windows users.
|
| 72 |
+
|
| 73 |
+
```
|
| 74 |
+
git clone https://github.com/PanQiWei/AutoGPTQ
|
| 75 |
+
cd AutoGPTQ
|
| 76 |
+
pip install . # This step requires CUDA toolkit installed
|
| 77 |
+
```
|
| 78 |
+
|
| 79 |
+
5. Then launch text-generation-webui as described below
|
| 80 |
|
| 81 |
## How to download and use this model in text-generation-webui
|
| 82 |
|