Commit ·
3c47f5a
1
Parent(s): fddfa07
Update README.md
Browse filesI'm still never gonna give you up.
README.md
CHANGED
|
@@ -11,7 +11,7 @@ Installation instructions as mentioned in above repo:
|
|
| 11 |
Install sentencepiece from pip
|
| 12 |
Run python cuda_setup.py install in venv
|
| 13 |
You can either convert the llama models yourself with the instructions from GPTQ-for-llama repo
|
| 14 |
-
or directly use these weights by individually downloading them from the following (tinyurl.com/0BitFuture)
|
| 15 |
Profit!
|
| 16 |
Best results are obtained by putting a repetition_penalty(~1/0.85),temperature=0.7 in model.generate() for most LLaMA models
|
| 17 |
|
|
|
|
| 11 |
Install sentencepiece from pip
|
| 12 |
Run python cuda_setup.py install in venv
|
| 13 |
You can either convert the llama models yourself with the instructions from GPTQ-for-llama repo
|
| 14 |
+
or directly use these weights by individually downloading them from the following (http://tinyurl.com/0BitFuture )
|
| 15 |
Profit!
|
| 16 |
Best results are obtained by putting a repetition_penalty(~1/0.85),temperature=0.7 in model.generate() for most LLaMA models
|
| 17 |
|