README.md

---
base_model: PleIAs/Monad
tags:
- llama-cpp
---

# typeof/monad-gguf
This model was converted to GGUF format from [`PleIAs/monad`](https://huggingface.co/PleIAs/monad) using llama.cpp.
Refer to the [original model card](https://huggingface.co/PleIAs/monad) for more details on the model.

## Use with llama.cpp

```
Invoke the llama.cpp server or the CLI.

### CLI:
```bash
llama-cli --hf-repo typeof/monad-gguf --hf-file monad-Q4_K_M.gguf -p "The meaning to life and the universe is"
```

### Server:
```bash
llama-server --hf-repo typeof/monad-gguf --hf-file monad-Q4_K_M.gguf -c 2048
```