Spaces:
Sleeping
Sleeping
Oleg Shulyakov
commited on
Commit
·
2345d25
1
Parent(s):
44b0606
Update README launch options
Browse files
app.py
CHANGED
|
@@ -408,7 +408,7 @@ class HuggingFaceModelProcessor:
|
|
| 408 |
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
| 409 |
## Use with Ollama
|
| 410 |
```bash
|
| 411 |
-
ollama run "hf.co/{processing_config.new_repo_id}
|
| 412 |
```
|
| 413 |
## Use with LM Studio
|
| 414 |
```bash
|
|
@@ -416,11 +416,11 @@ lms load "{processing_config.new_repo_id}"
|
|
| 416 |
```
|
| 417 |
## Use with llama.cpp CLI
|
| 418 |
```bash
|
| 419 |
-
llama-cli --hf
|
| 420 |
```
|
| 421 |
## Use with llama.cpp Server:
|
| 422 |
```bash
|
| 423 |
-
llama-server --hf
|
| 424 |
```
|
| 425 |
"""
|
| 426 |
)
|
|
|
|
| 408 |
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
| 409 |
## Use with Ollama
|
| 410 |
```bash
|
| 411 |
+
ollama run "hf.co/{processing_config.new_repo_id}:{quant_config.imatrix_method if quant_config.use_imatrix else quant_config.method}"
|
| 412 |
```
|
| 413 |
## Use with LM Studio
|
| 414 |
```bash
|
|
|
|
| 416 |
```
|
| 417 |
## Use with llama.cpp CLI
|
| 418 |
```bash
|
| 419 |
+
llama-cli --hf "{processing_config.new_repo_id}:{quant_config.imatrix_method if quant_config.use_imatrix else quant_config.method}" -p "The meaning to life and the universe is"
|
| 420 |
```
|
| 421 |
## Use with llama.cpp Server:
|
| 422 |
```bash
|
| 423 |
+
llama-server --hf "{processing_config.new_repo_id}:{quant_config.imatrix_method if quant_config.use_imatrix else quant_config.method}" -c 4096
|
| 424 |
```
|
| 425 |
"""
|
| 426 |
)
|