| | --- |
| | language: en |
| | license: apache-2.0 |
| | tags: |
| | - linux |
| | - command-generation |
| | - gguf |
| | - qwen3 |
| | - llama-cpp |
| | - offline |
| | base_model: Qwen/Qwen3.5-0.8B |
| | --- |
| | |
| | # INCEPT.sh |
| |
|
| | Offline command inference engine for Linux. Fine-tuned **Qwen3.5-0.8B** (GGUF Q8_0, 774MB) designed to run on low-resource and edge devices with no GPU, no API, and no internet connection required at runtime. |
| | |
| | **Benchmark:** 99/100 on a structured 100-question Linux command evaluation (Ubuntu 22.04, bash, non-root). |
| | |
| | ## Installation |
| | |
| | ```bash |
| | curl -fsSL https://raw.githubusercontent.com/0-Time/INCEPT.sh/main/install.sh | bash |
| | ``` |
| | |
| | Supports: Debian/Ubuntu, RHEL/Fedora, CentOS, Arch, openSUSE. |
| | |
| | ## Manual Model Setup |
| | |
| | ```bash |
| | # Download model |
| | huggingface-cli download 0Time/INCEPT-SH \ |
| | incept-sh.gguf --local-dir ./models |
| | |
| | # Clone and install |
| | git clone https://github.com/0-Time/INCEPT.sh |
| | cd INCEPT.sh |
| | pip install -e ".[cli]" |
| | incept |
| | ``` |
| | |
| | ## Usage |
| | |
| | ```bash |
| | # Interactive CLI |
| | incept |
| | |
| | # One-shot |
| | incept -c "list all open ports" |
| | |
| | # Minimal output (pipe-friendly) |
| | incept -c "find large files" -m |
| | |
| | # With model reasoning |
| | incept --think |
| | ``` |
| | |
| | ## CLI Commands |
| | |
| | | Command | Description | |
| | |---|---| |
| | | `/think on\|off` | Toggle chain-of-thought reasoning | |
| | | `/context` | Show detected system context | |
| | | `/help` | List available commands | |
| | | `/exit` | Exit | |
| | |
| | ## Prompt Format |
| | |
| | ChatML with a system context line: |
| | |
| | ``` |
| | <|im_start|>system |
| | ubuntu 22.04 bash non-root |
| | <|im_end|> |
| | <|im_start|>user |
| | {natural language query} |
| | <|im_end|> |
| | <|im_start|>assistant |
| | <think> |
| | </think> |
| |
|
| | ``` |
| | |
| | Inference temperature: **0.0** (greedy decoding). |
| | |
| | ## Training |
| | |
| | | Parameter | Value | |
| | |-----------------------|----------------------------------------------| |
| | | Base model | Qwen/Qwen3.5-0.8B | |
| | | Training method | Supervised fine-tuning (LoRA, rank 16) | |
| | | Training examples | 79,264 (SFT) + 11,306 (pipe refinement) | |
| | | Learning rate | 5×10⁻⁵ | |
| | | Quantization | Q8_0 (774MB) | |
| | | Supported distros | Ubuntu, Debian, RHEL, Arch, Fedora, CentOS | |
| | | Training hardware | Apple M4 Mac mini, 32GB unified RAM | |
| | |
| | ## Safety |
| | |
| | - Prompt injection detection (exact-phrase matching) |
| | - Catastrophic pattern blocking (`rm -rf /`, fork bombs, pipe-to-shell, etc.) |
| | - Risk classification: `SAFE` / `CAUTION` / `DANGEROUS` / `BLOCKED` |
| | - Zero outbound traffic at runtime |
| | |
| | ## Requirements |
| | |
| | - Linux x86_64 / aarch64 |
| | - Python 3.11+ |
| | - [`llama-server`](https://github.com/ggerganov/llama.cpp) on `PATH` |
| | - ~1GB RAM at runtime |
| | |
| | ## Links |
| | |
| | - **GitHub:** [0-Time/INCEPT.sh](https://github.com/0-Time/INCEPT.sh) |
| | - **Release:** [v1.0.0](https://github.com/0-Time/INCEPT.sh/releases/tag/v1.0.0) |
| | |
| | ## License |
| | |
| | [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
| | |
