README.md

---
title: DevOps Metrics Interpreter
emoji: 📊
colorFrom: blue
colorTo: indigo
sdk: docker
pinned: false
---

# DevOps Metrics Interpreter

Enter your team's DevOps metrics and get a plain-language interpretation compared to DORA benchmark data from the State of DevOps Reports.

## How report generation works

Reports are generated by combining three sources of knowledge, all extracted from the State of DevOps Report PDFs and stored in `data/benchmarks.json`:

1. **Benchmark tiers** — elite/high/medium/low bands for the four DORA metrics (deployment frequency, lead time, change failure rate, MTTR)
2. **47 patterns** — metric combinations and what they signal (e.g. high deploy frequency + high failure rate → missing release safeguards)
3. **124 key insights** — statistics and findings from the reports (e.g. "elite performers deploy 208x more frequently than low performers")

All three are injected into the LLM's system prompt on every request alongside the team's submitted metrics. The LLM is instructed to reference benchmark bands explicitly and ground its improvement recommendations in the extracted knowledge.

Report quality depends on what was captured during extraction. To re-extract with a better model:

```bash
LLM_MODEL=gpt-4o npm run extract
```

## Running locally

```bash
cp .env.local.example .env.local
# Edit .env.local with your settings
npm install
npm run dev
```

## Environment variables (HF Space settings)

| Variable | Value |
|----------|-------|
| `OLLAMA_BASE_URL` | `https://router.huggingface.co/v1` |
| `OPENAI_API_KEY` | Your HuggingFace token (`hf_...`) |
| `LLM_MODEL` | `Qwen/Qwen2.5-72B-Instruct` |