Oleg Shulyakov commited on
Commit
2345d25
·
1 Parent(s): 44b0606

Update README launch options

Browse files
Files changed (1) hide show
  1. app.py +3 -3
app.py CHANGED
@@ -408,7 +408,7 @@ class HuggingFaceModelProcessor:
408
  🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
409
  ## Use with Ollama
410
  ```bash
411
- ollama run "hf.co/{processing_config.new_repo_id}:<quantization>"
412
  ```
413
  ## Use with LM Studio
414
  ```bash
@@ -416,11 +416,11 @@ lms load "{processing_config.new_repo_id}"
416
  ```
417
  ## Use with llama.cpp CLI
418
  ```bash
419
- llama-cli --hf-repo "{processing_config.new_repo_id}" --hf-file "{processing_config.output_config.filename}" -p "The meaning to life and the universe is"
420
  ```
421
  ## Use with llama.cpp Server:
422
  ```bash
423
- llama-server --hf-repo "{processing_config.new_repo_id}" --hf-file "{processing_config.output_config.filename}" -c 4096
424
  ```
425
  """
426
  )
 
408
  🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
409
  ## Use with Ollama
410
  ```bash
411
+ ollama run "hf.co/{processing_config.new_repo_id}:{quant_config.imatrix_method if quant_config.use_imatrix else quant_config.method}"
412
  ```
413
  ## Use with LM Studio
414
  ```bash
 
416
  ```
417
  ## Use with llama.cpp CLI
418
  ```bash
419
+ llama-cli --hf "{processing_config.new_repo_id}:{quant_config.imatrix_method if quant_config.use_imatrix else quant_config.method}" -p "The meaning to life and the universe is"
420
  ```
421
  ## Use with llama.cpp Server:
422
  ```bash
423
+ llama-server --hf "{processing_config.new_repo_id}:{quant_config.imatrix_method if quant_config.use_imatrix else quant_config.method}" -c 4096
424
  ```
425
  """
426
  )