Change to base & fix duplicate flag - English
#1
by
algorithm
- opened
README.md
CHANGED
|
@@ -298,13 +298,13 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-
|
|
| 298 |
- How to convert to GGUF model
|
| 299 |
|
| 300 |
```shell
|
| 301 |
-
python convert-hf-to-gguf.py path/to/Orion-14B-
|
| 302 |
```
|
| 303 |
|
| 304 |
- How to run generation
|
| 305 |
|
| 306 |
```shell
|
| 307 |
-
./main --frequency-penalty 0.5 --
|
| 308 |
```
|
| 309 |
|
| 310 |
## 4.6 Example Output
|
|
|
|
| 298 |
- How to convert to GGUF model
|
| 299 |
|
| 300 |
```shell
|
| 301 |
+
python convert-hf-to-gguf.py path/to/Orion-14B-Base --outfile base.gguf
|
| 302 |
```
|
| 303 |
|
| 304 |
- How to run generation
|
| 305 |
|
| 306 |
```shell
|
| 307 |
+
./main --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m base.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e
|
| 308 |
```
|
| 309 |
|
| 310 |
## 4.6 Example Output
|