| title: Stealth Rifle API | |
| emoji: 🎯 | |
| colorFrom: gray | |
| colorTo: blue | |
| sdk: docker | |
| app_port: 7860 | |
| pinned: false | |
| license: mit | |
| models: | |
| - cloudunity/stealth-rifle | |
| # Stealth-Rifle API | |
| OpenAI-compatible inference for [`cloudunity/stealth-rifle`](https://huggingface.co/cloudunity/stealth-rifle) | |
| (a CPU-friendly Qwen2.5-0.5B roleplay fine-tune, Q4_K_M GGUF), served by | |
| llama.cpp on the free CPU tier (16GB RAM / 2 vCPU). | |
| ## Endpoints | |
| Base URL: `https://cloudunity-stealth-rifle-api.hf.space` | |
| - `GET /v1/models` | |
| - `POST /v1/chat/completions` | |
| - `POST /v1/completions` | |
| - `GET /health` | |
| ## Example | |
| ```bash | |
| curl https://cloudunity-stealth-rifle-api.hf.space/v1/chat/completions \ | |
| -H "Content-Type: application/json" \ | |
| -d '{ | |
| "model": "stealth-rifle", | |
| "messages": [ | |
| {"role": "system", "content": "You are Kael, a dry-witted exiled mage."}, | |
| {"role": "user", "content": "You find me bleeding by the road. What do you do?"} | |
| ], | |
| "temperature": 0.8, | |
| "max_tokens": 300 | |
| }' | |
| ``` | |
| Works with any OpenAI client by pointing `base_url` at | |
| `https://cloudunity-stealth-rifle-api.hf.space/v1` (any/empty API key). | |