stealth-rifle-api / README.md
cloudunity's picture
Upload README.md with huggingface_hub
fd674ab verified
|
Raw
History Blame Contribute Delete
1.14 kB
---
title: Stealth Rifle API
emoji: 🎯
colorFrom: gray
colorTo: blue
sdk: docker
app_port: 7860
pinned: false
license: mit
models:
- cloudunity/stealth-rifle
---
# Stealth-Rifle API
OpenAI-compatible inference for [`cloudunity/stealth-rifle`](https://huggingface.co/cloudunity/stealth-rifle)
(a CPU-friendly Qwen2.5-0.5B roleplay fine-tune, Q4_K_M GGUF), served by
llama.cpp on the free CPU tier (16GB RAM / 2 vCPU).
## Endpoints
Base URL: `https://cloudunity-stealth-rifle-api.hf.space`
- `GET /v1/models`
- `POST /v1/chat/completions`
- `POST /v1/completions`
- `GET /health`
## Example
```bash
curl https://cloudunity-stealth-rifle-api.hf.space/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "stealth-rifle",
"messages": [
{"role": "system", "content": "You are Kael, a dry-witted exiled mage."},
{"role": "user", "content": "You find me bleeding by the road. What do you do?"}
],
"temperature": 0.8,
"max_tokens": 300
}'
```
Works with any OpenAI client by pointing `base_url` at
`https://cloudunity-stealth-rifle-api.hf.space/v1` (any/empty API key).