File size: 2,419 Bytes
8896ebe | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 | ---
license: apache-2.0
language:
- en
library_name: gguf
tags:
- gguf
- shell
- macos
- terminal
- command-line
- qwen2
- lora
- ollama
base_model: Qwen/Qwen2.5-1.5B
model_name: harshell
pipeline_tag: text-generation
quantized_by: josharsh
---
# Harshell - Natural Language to macOS Shell Commands
**Harshell** is a fine-tuned Qwen 2.5 1.5B model that converts natural language into macOS shell commands. It returns only the command — no explanations, no markdown, just the shell command you need.
## Model Details
| Property | Value |
|---|---|
| Base Model | Qwen 2.5 1.5B |
| Fine-tuning | LoRA (rank 8, 1000 iterations) |
| Quantization | Q8_0 GGUF |
| File Size | ~1.5 GB |
| License | Apache 2.0 |
## Quick Start with Ollama
1. Download the GGUF and Modelfile from this repo
2. Create the model:
```bash
ollama create harshell -f Modelfile
```
3. Run it:
```bash
ollama run harshell "list all pdf files in my downloads folder"
```
### Example Usage
| Input | Output |
|---|---|
| list all pdf files in downloads | `find ~/Downloads -name "*.pdf"` |
| show disk usage of current folder | `du -sh .` |
| kill the process on port 3000 | `lsof -ti:3000 \| xargs kill` |
| compress this folder into a zip | `zip -r archive.zip .` |
| show my ip address | `ifconfig \| grep "inet " \| grep -v 127.0.0.1` |
## System Prompt
The model uses this system prompt:
> You are a macOS terminal assistant. Convert natural language into safe shell commands. Return only the command, nothing else.
## Ollama Modelfile
The included `Modelfile` configures:
- **Temperature**: 0.3 (low for deterministic command output)
- **Top-p**: 0.9
- **Max tokens**: 128
- **Chat template**: ChatML format (`<|im_start|>` / `<|im_end|>`)
## Training Details
- **Method**: LoRA (Low-Rank Adaptation)
- **LoRA Rank**: 8
- **Training iterations**: 1000
- **Base model**: Qwen/Qwen2.5-1.5B
- **Dataset**: Curated natural language → macOS shell command pairs
- **Quantization**: Converted to GGUF Q8_0 using llama.cpp
## Files
- `harsh-shell-q8_0.gguf` — The quantized model (Q8_0, ~1.5GB)
- `Modelfile` — Ollama configuration file
## Limitations
- Optimized for **macOS** commands; Linux/Windows commands may be less accurate
- Best for single-line commands; complex multi-line scripts may not generate correctly
- Always review generated commands before running them, especially destructive operations (`rm`, `mv`, etc.)
|