Spaces:
Running
title: DeepShell
emoji: π»
colorFrom: green
colorTo: blue
sdk: docker
dockerfile: Dockerfile.hf
app_port: 7860
license: mit
short_description: AI DevOps assistant with Hindi TTS β Linux, Docker, K8s
pinned: false
tags:
- devops
- linux
- docker
- kubernetes
- fastapi
- tts
- hindi
- sysadmin
- llm
- groq
- piper
- infrastructure
- cloud
- ansible
- terraform
π» DeepShell ModUI
AI-powered DevOps assistant AND trainer β specialized for Linux SysAdmin, DevOps, Docker, Kubernetes, IaC, and Cloud operations. Not a generic ChatGPT wrapper. Strictly focused. Blazing fast. Runs 100% offline with Ollama.
Real-time streaming β’ 3 AI modes β’ Multilingual Voice TTS β’ Syntax highlighting β’ Light/Dark theme β’ Docker ready β’ Groq + Cerebras + Ollama
π What is DeepShell ModUI?
DeepShell ModUI is a fast, minimal web application that brings AI assistance directly into your infrastructure workflows:
- Frontend: Responsive chat UI β Vanilla JS, zero frameworks, light/dark theme
- Backend: FastAPI with SSE streaming + /translate + /tts endpoints
- LLM: Groq (default) β Cerebras (failover) β Ollama (offline)
- Smart Context: Maintains conversation history for better responses
- Strict Scope: Refuses off-topic questions β stays on DevOps/SysAdmin only
- Three Modes: Assistant, Trainer, and Dry Run
- Multilingual TTS: Piper (offline, self-hosted) for Hindi + Web Speech API for English
Perfect for DevOps engineers, SysAdmins, Cloud admins, and IaC Specialists who need accurate commands and scripts β fast.
π€ Three Modes β One Tool
π΅ Assistant Mode (Default)
Fast, direct answers. Commands, scripts, and explanations for DevOps tasks.
π Trainer Mode
Structured teaching format β ideal for learning and upskilling. Every response follows a consistent teaching structure with What it does, Command/Example, Breaking it down, Common mistakes, Try this next, and Pro tip sections.
π Dry Run Mode
Safety-first command analysis β see exactly what WOULD happen before running anything. Shows risk level and safe alternatives.
Toggle between modes instantly using the Assistant / Trainer / Dry Run buttons in the header.
β¨ Features
Free Version
- β Assistant Mode β fast, direct DevOps answers
- β Trainer Mode β structured teaching with examples and pro tips
- β Dry Run Mode β safety-first command analysis before execution
- β π Multilingual Voice TTS β English (Web Speech API) + Hindi via Piper (self-hosted, offline)
- β π Language selector β EN / HI / TA / TE / AR in header dropdown
- β π Replay β replay last response anytime
- β π/βοΈ Theme toggle β light and dark mode with persistence
- β Real-time streaming responses via SSE
- β Syntax highlighting β Bash, Python, Dockerfile, YAML, HCL (Terraform)
- β Session context β AI remembers your conversation
- β Copy buttons on all code blocks
- β Export chat as Markdown file
- β Clear chat to reset session
- β Keyboard shortcuts (Ctrl+Enter, Ctrl+K, Escape)
- β Green status indicator β live backend health check
- β Strict AI scope β politely refuses off-topic questions
- β Works locally or over LAN
- β Docker Compose β DeepShell + LibreTranslate as sidecar
- β Start/Stop scripts β no terminal lock
- β Groq β blazing fast cloud inference
- β Cerebras β failover provider
- β Ollama β run 100% offline, no API key needed
Coming Soon β Pro Version π
- π One-click command execution with approval flow
- π Persistent chat history (database)
- π Multi-host support (remote server connections)
- π Workflow automation and command chaining
- π File upload β analyze logs and configs
- π Chatterbox TTS β cloned voice as your personal instructor
- π Quiz mode for certification prep (RHCSA, CKA, AWS)
- π Stop audio on language switch
π οΈ Tech Stack
| Layer | Technology |
|---|---|
| Frontend | HTML5, CSS3, Vanilla JavaScript |
| Backend | FastAPI, Uvicorn, SSE |
| LLM (Cloud) | Groq API β llama-3.3-70b-versatile |
| LLM (Failover) | Cerebras β llama3.1-8b |
| LLM (Local) | Ollama β phi3, qwen2.5-coder, llama3 etc |
| Syntax | Prism.js (dark + light themes) |
| Markdown | marked.js |
| TTS (English) | Web Speech API (browser native) |
| TTS (Hindi) | Piper TTS β hi_IN-rohan-medium (self-hosted, offline) |
| Translation | LibreTranslate (self-hosted, enβhi) |
| Python | 3.11+ |
π Multilingual TTS Architecture
DeepShell uses a self-hosted translation + TTS pipeline β no cloud APIs, no rate limits, no data leaving your network:
- English: Web Speech API (browser built-in, zero latency)
- Hindi: LibreTranslate β Piper TTS (offline, self-hosted)
- Sentence-by-sentence: Audio starts immediately, no full-response wait
- Fallback: If backend TTS fails, falls back to Web Speech API automatically
β οΈ Note: Switching language mid-playback does not stop current audio. This will be fixed in a future release.
πΌοΈ Preview
π Live Demo: deepshell.cloud β try it directly in your browser!
β‘ Quick Start (Python β No Docker)
Prerequisites
- Python 3.11+
- Git
- Groq API key β Get one free OR Ollama for offline use
1. Clone and Install
git clone https://github.com/muralipala1504/deepshell_modui.git
cd deepshell_modui
pip install -r deepshell-backend/requirements.txt
pip install httpx
pip install -e deepshell-backend/
2. Set Groq API Key
echo 'export GROQ_API_KEY="your_groq_api_key_here"' >> ~/.bashrc
source ~/.bashrc
3. Install Piper TTS (Hindi voice)
cd ~
wget https://github.com/rhasspy/piper/releases/download/2023.11.14-2/piper_linux_x86_64.tar.gz
tar -xzf piper_linux_x86_64.tar.gz
mkdir -p ~/piper/voices
wget https://huggingface.co/rhasspy/piper-voices/resolve/main/hi/hi_IN/rohan/medium/hi_IN-rohan-medium.onnx -O ~/piper/voices/hi_IN-rohan-medium.onnx
wget https://huggingface.co/rhasspy/piper-voices/resolve/main/hi/hi_IN/rohan/medium/hi_IN-rohan-medium.onnx.json -O ~/piper/voices/hi_IN-rohan-medium.onnx.json
4. Install LibreTranslate (Hindi translation)
python3 -m venv ~/.venvs/libretranslate
source ~/.venvs/libretranslate/bin/activate
pip install libretranslate==1.9.5
deactivate
5. Firewall (remote/LAN access only)
# firewalld (RHEL/CentOS/Fedora/AlmaLinux)
sudo firewall-cmd --add-port=8001/tcp --permanent
sudo firewall-cmd --add-port=5000/tcp --permanent
sudo firewall-cmd --reload
# ufw (Ubuntu/Debian)
sudo ufw allow 8001/tcp
sudo ufw allow 5000/tcp
6. Start / Stop
# Start DeepShell + LibreTranslate in background
./start.sh
# Check logs
tail -f deepshell.log
tail -f libretranslate.log
# Stop everything
./stop.sh
7. Open in Browser
π― What DeepShell Excels At
| Domain | Examples |
|---|---|
| π³ Docker | Dockerfiles, compose files, container management |
| βΈοΈ Kubernetes | kubectl commands, YAML manifests, troubleshooting |
| π§ Linux SysAdmin | System commands, log analysis, performance tuning |
| ποΈ IaC | Terraform (HCL), Ansible, CloudFormation |
| βοΈ Cloud | AWS CLI, best practices |
| π Scripting | Bash, Python automation for ops tasks |
DeepShell politely refuses general knowledge, entertainment, or anything outside DevOps/SysAdmin scope.
π Security & Safety
- β No automatic execution β commands displayed with copy buttons only
- β Dry Run mode β analyze before you execute
- β User control β you decide what runs on your system
- β Session isolation β each browser session is independent
- β No data persistence β conversations in-memory only (free version)
- β Rate limiting β built-in via slowapi
- β Strict AI scope β refuses off-topic requests
- β Ollama option β LLM data never leaves your network
- β Self-hosted TTS β Piper runs locally, no audio sent to cloud
β¨οΈ Keyboard Shortcuts
| Shortcut | Action |
|---|---|
Ctrl + Enter |
Send message |
Ctrl + K |
Clear chat |
Escape |
Focus input |
π£οΈ Roadmap
Phase 1 β Free Version β Complete
- β SSE streaming + session context
- β Syntax highlighting (Bash, Python, Dockerfile, YAML, HCL)
- β Copy buttons + Export chat as Markdown
- β Docker Compose support + Start/Stop scripts
- β Assistant / Trainer / Dry Run modes
- β Multilingual Voice TTS β English + Hindi (Piper, offline)
- β Self-hosted translation via LibreTranslate
- β Backend /translate + /tts endpoints
- β Replay + Light/Dark theme
- β Groq + Cerebras + Ollama provider support
Phase 2 β Pro Version π Next
- π One-click command execution with approval flow
- π Persistent history (database)
- π Chatterbox TTS β cloned voice instructor
- π Quiz mode for certification prep (RHCSA, CKA, AWS)
- π Multi-session management
- π Workflow automation
- π Stop audio on language switch
Phase 3 β Advanced
- π File upload (analyze logs, configs)
- π Multi-host support
- π Kubernetes dashboard integration
- π Additional Indian languages (Tamil, Telugu)
π€ Contributing
Contributions welcome! Please:
- Keep code simple and maintainable
- Focus on DevOps/SysAdmin/IaC use cases
- Follow existing code style
- Test before submitting PRs
π License
MIT License β see LICENSE for details.
π Acknowledgments
- Groq β blazing-fast LLM inference
- Cerebras β fast failover inference
- Ollama β local LLM runtime
- FastAPI β excellent async framework
- Piper TTS β fast offline neural TTS
- LibreTranslate β self-hosted translation
- Prism.js β syntax highlighting
- marked.js β markdown rendering
π§ Contact
Maintainer: @muralipala1504 Issues: GitHub Issues Website: deepshell.cloud β LIVE
Built with β€οΈ for DevOps engineers who value speed, accuracy, and control.