Change to base & fix duplicate flag - ZH
#4
by
algorithm
- opened
- README_zh.md +2 -2
README_zh.md
CHANGED
|
@@ -286,13 +286,13 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-
|
|
| 286 |
- 如何转换GGUF格式模型
|
| 287 |
|
| 288 |
```shell
|
| 289 |
-
python convert-hf-to-gguf.py path/to/Orion-14B-
|
| 290 |
```
|
| 291 |
|
| 292 |
- 如何运行GGUF格式模型推理
|
| 293 |
|
| 294 |
```shell
|
| 295 |
-
./main --frequency-penalty 0.5 --
|
| 296 |
```
|
| 297 |
|
| 298 |
## 4.6. 示例输出
|
|
|
|
| 286 |
- 如何转换GGUF格式模型
|
| 287 |
|
| 288 |
```shell
|
| 289 |
+
python convert-hf-to-gguf.py path/to/Orion-14B-Base --outfile base.gguf
|
| 290 |
```
|
| 291 |
|
| 292 |
- 如何运行GGUF格式模型推理
|
| 293 |
|
| 294 |
```shell
|
| 295 |
+
./main --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m base.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e
|
| 296 |
```
|
| 297 |
|
| 298 |
## 4.6. 示例输出
|