How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf StealthyML/StealthyLM-Emotive
# Run inference directly in the terminal:
llama cli -hf StealthyML/StealthyLM-Emotive
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf StealthyML/StealthyLM-Emotive
# Run inference directly in the terminal:
llama cli -hf StealthyML/StealthyLM-Emotive
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf StealthyML/StealthyLM-Emotive
# Run inference directly in the terminal:
./llama-cli -hf StealthyML/StealthyLM-Emotive
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf StealthyML/StealthyLM-Emotive
# Run inference directly in the terminal:
./build/bin/llama-cli -hf StealthyML/StealthyLM-Emotive
Use Docker
docker model run hf.co/StealthyML/StealthyLM-Emotive
Quick Links

StealthyLM β€” Skadoosh Voice Model

Spoken-dialogue engine for Skadoosh. Fine-tuned Qwen2.5-1.5B-Instruct optimized for clause-level streaming TTS, real barge-in, and fully local edge inference.

Why This Model

Skadoosh streams TTS per-clause and supports instant barge-in [[9]]. Standard LLMs break this pipeline with markdown, long responses, and tone-deaf output. StealthyLM fixes all three:

  • Zero markdown β€” clean text for Kokoro TTS, no formatting artifacts
  • Short clauses β€” matches Skadoosh's clause-level streaming architecture
  • Emotion-aware β€” contextual tone matching beyond keyword-driven detect_tone [[9]]
  • Grounded β€” says "I'm not sure" instead of hallucinating during tool execution
  • Edge-ready β€” Q4_K_M GGUF runs on Raspberry Pi with sub-150ms latency target [[9]]

Quick Start

# Drop into your Skadoosh models directory
mv StealthyLM_Q4KM.gguf models/

# Run Skadoosh with StealthyLM
skadoosh --llm-model StealthyLM_Q4KM.gguf --tts-emotion
Downloads last month
79
GGUF
Model size
2B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Dataset used to train StealthyML/StealthyLM-Emotive