README.md

metadata

title: DevOps Metrics Interpreter
emoji: 📊
colorFrom: blue
colorTo: indigo
sdk: docker
pinned: false

DevOps Metrics Interpreter

Enter your team's DevOps metrics and get a plain-language interpretation compared to DORA benchmark data from the State of DevOps Reports.

How report generation works

Reports are generated by combining three sources of knowledge, all extracted from the State of DevOps Report PDFs and stored in data/benchmarks.json:

1. Benchmark tiers — elite/high/medium/low bands for the four DORA metrics (deployment frequency, lead time, change failure rate, MTTR)
2. 47 patterns — metric combinations and what they signal (e.g. high deploy frequency + high failure rate → missing release safeguards)
3. 124 key insights — statistics and findings from the reports (e.g. "elite performers deploy 208x more frequently than low performers")

All three are injected into the LLM's system prompt on every request alongside the team's submitted metrics. The LLM is instructed to reference benchmark bands explicitly and ground its improvement recommendations in the extracted knowledge.

Report quality depends on what was captured during extraction. To re-extract with a better model:

LLM_MODEL=gpt-4o npm run extract

Running locally

cp .env.local.example .env.local
# Edit .env.local with your settings
npm install
npm run dev

Environment variables (HF Space settings)

Variable	Value
OLLAMA_BASE_URL	https://router.huggingface.co/v1
OPENAI_API_KEY	Your HuggingFace token (hf_...)
LLM_MODEL	Qwen/Qwen2.5-72B-Instruct