|
|
--- |
|
|
base_model: PleIAs/Monad |
|
|
tags: |
|
|
- llama-cpp |
|
|
--- |
|
|
|
|
|
# typeof/monad-gguf |
|
|
This model was converted to GGUF format from [`PleIAs/monad`](https://huggingface.co/PleIAs/monad) using llama.cpp. |
|
|
Refer to the [original model card](https://huggingface.co/PleIAs/monad) for more details on the model. |
|
|
|
|
|
## Use with llama.cpp |
|
|
|
|
|
``` |
|
|
Invoke the llama.cpp server or the CLI. |
|
|
|
|
|
### CLI: |
|
|
```bash |
|
|
llama-cli --hf-repo typeof/monad-gguf --hf-file monad-Q4_K_M.gguf -p "The meaning to life and the universe is" |
|
|
``` |
|
|
|
|
|
### Server: |
|
|
```bash |
|
|
llama-server --hf-repo typeof/monad-gguf --hf-file monad-Q4_K_M.gguf -c 2048 |
|
|
``` |
|
|
|
