---
title: Ollive OSS API
emoji: 🫒
colorFrom: yellow
colorTo: red
sdk: docker
app_port: 7860
pinned: false
license: mit
---

# Ollive OSS API

FastAPI service: chat, guardrails, tools, OpenTelemetry traces UI, inference metrics.

| Endpoint | Description |
|----------|-------------|
| `/docs` | Swagger UI |
| `/v1/chat` | Chat API |
| `/v1/traces/ui` | Observability dashboard |
| `/v1/metrics/inference` | TTFT, TBT, latency |

## Space setup (monorepo)

1. Create a **Docker** Space on Hugging Face.
2. Connect this GitHub repo.
3. Set **Space directory** (subpath) to: `deploy/hf-api`
4. Add **Secrets**: `HF_TOKEN` (gated models), optional `API_SERVICE_KEY`.

## Local build

```bash
docker build -f deploy/hf-api/Dockerfile -t ollive-api .
docker run --rm -p 7860:7860 --env-file .env ollive-api
```

Open http://localhost:7860/v1/traces/ui