---
license: apache-2.0
library_name: gguf
base_model: fableforge-ai/ShellWhisperer-1.5B
base_model_relation: quantized
tags:
- gguf
- fableforge
- shellwhisperer
- 1.5b
- llama.cpp
- lm-studio
- ollama
- text-generation
- uncensored
- agent
- tool-use
- en
pipeline_tag: text-generation
---

# ShellWhisperer-1.5B-GGUF

GGUF quantizations of [fableforge-ai/ShellWhisperer-1.5B](https://huggingface.co/fableforge-ai/ShellWhisperer-1.5B), a 1.5B parameter instruction-tuned model optimized for shell command generation, agentic tool use, and uncensored reasoning.

## Available Quants

| Quant | File |
|---|---|
| F16 | `shellwhisperer-1.5b-f16.gguf` |
| Q8_0 | `shellwhisperer-1.5b-Q8_0.gguf` |
| Q6_K | `shellwhisperer-1.5b-Q6_K.gguf` |
| Q5_K_M | `shellwhisperer-1.5b-Q5_K_M.gguf` |
| Q4_K_M | `shellwhisperer-1.5b-Q4_K_M.gguf` |
| Q4_0 | `shellwhisperer-1.5b-Q4_0.gguf` |
| Q3_K_M | `shellwhisperer-1.5b-Q3_K_M.gguf` |
| Q2_K | `shellwhisperer-1.5b-Q2_K.gguf` |
| IQ4_XS | `shellwhisperer-1.5b-IQ4_XS.gguf` |
| IQ3_XXS | `shellwhisperer-1.5b-IQ3_XXS.gguf` |
| IQ2_XXS | `shellwhisperer-1.5b-IQ2_XXS.gguf` |
| IQ1_S | `shellwhisperer-1.5b-IQ1_S.gguf` |

## Usage

### llama.cpp

```bash
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make -j
./main -m shellwhisperer-1.5b-Q4_K_M.gguf -p "Generate a bash script to..." -n 512
```

### Ollama

```bash
ollama run hf.co/fableforge-ai/ShellWhisperer-1.5B-GGUF:Q4_K_M
```

### LM Studio

Search for "ShellWhisperer" in the LM Studio search panel.

---

## 🔗 Related models

- 🧠 Base model (safetensors): [`ShellWhisperer-1.5B`](https://huggingface.co/fableforge-ai/ShellWhisperer-1.5B)