stealth-rifle-api / README.md
cloudunity's picture
Upload README.md with huggingface_hub
fd674ab verified
|
Raw
History Blame Contribute Delete
1.14 kB
metadata
title: Stealth Rifle API
emoji: 🎯
colorFrom: gray
colorTo: blue
sdk: docker
app_port: 7860
pinned: false
license: mit
models:
  - cloudunity/stealth-rifle

Stealth-Rifle API

OpenAI-compatible inference for cloudunity/stealth-rifle (a CPU-friendly Qwen2.5-0.5B roleplay fine-tune, Q4_K_M GGUF), served by llama.cpp on the free CPU tier (16GB RAM / 2 vCPU).

Endpoints

Base URL: https://cloudunity-stealth-rifle-api.hf.space

  • GET /v1/models
  • POST /v1/chat/completions
  • POST /v1/completions
  • GET /health

Example

curl https://cloudunity-stealth-rifle-api.hf.space/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "stealth-rifle",
    "messages": [
      {"role": "system", "content": "You are Kael, a dry-witted exiled mage."},
      {"role": "user", "content": "You find me bleeding by the road. What do you do?"}
    ],
    "temperature": 0.8,
    "max_tokens": 300
  }'

Works with any OpenAI client by pointing base_url at https://cloudunity-stealth-rifle-api.hf.space/v1 (any/empty API key).