README.md

---
title: Bug Triage OpenEnv
colorFrom: blue
colorTo: green
sdk: docker
app_port: 7860
tags:
  - openenv
---

# Bug Triage OpenEnv

A simple OpenEnv environment for real-world software bug triage. The agent must classify tickets, assign them to the right team, detect duplicates, request missing information, and escalate urgent incidents.

## Why this environment

This is a real workflow, not a toy task. Software teams do bug triage every day, and progress can be measured step by step.

The environment includes:

- Typed `Observation`, `Action`, `Reward`, and `State` models with Pydantic
- Standard OpenEnv methods: `reset()`, `step()`, and `state()`
- Three deterministic tasks: easy, medium, and hard
- Programmatic graders with scores in `[0.0, 1.0]`
- Dense rewards for partial progress

## Observation and action space

Observation includes:

- Current ticket details
- Queue stats
- Available teams and components
- Steps used and remaining
- Partial score and last action result

Actions supported:

- `classify`
- `assign`
- `mark_duplicate`
- `request_info`
- `defer`
- `close`
- `escalate_incident`
- `next_ticket`

## Tasks

### `bug_triage_easy`

- Difficulty: easy
- 8 tickets
- Mostly clear bug reports with minimal duplicates

### `bug_triage_medium`

- Difficulty: medium
- 15 tickets
- Mixed-quality reports with duplicates and missing information

### `bug_triage_hard`

- Difficulty: hard
- 25 tickets
- Noisy tickets with SLA pressure and escalation trade-offs

## Reward and grading

The reward function gives feedback during the episode, not only at the end.

It rewards:

- Correct severity, priority, and component classification
- Correct team assignment
- Correct duplicate handling
- Correct information requests
- Correct escalation of critical tickets

It penalizes:

- Invalid actions
- Repeated loop behavior
- Missing escalation on critical tickets
- Incorrect close or defer decisions

Each task has a deterministic grader in `openenv_bug_triage/grader.py`.

## Setup

Install dependencies:

```bash
python -m venv venv
```

Windows PowerShell:

```powershell
venv\Scripts\Activate.ps1
pip install -r requirements.txt
```

macOS/Linux:

```bash
source venv/bin/activate
pip install -r requirements.txt
```

Validate:

```bash
openenv validate
```

## Run locally

Start the API:

```bash
uvicorn server.app:app --host 0.0.0.0 --port 7860
```

Main endpoints:

- `GET /reset`
- `POST /reset`
- `POST /step`
- `GET /state`
- `GET /tasks`
- `GET /health`

## Baseline inference

Submission runner:

```bash
python inference.py
```

Deterministic offline baseline:

```powershell
$env:OPENENV_OFFLINE = "1"
venv\Scripts\python.exe scripts\baseline_inference.py --offline --seed 42
```

Current offline baseline scores:

| Task | Score |
| --- | ---: |
| `bug_triage_easy` | `0.9920` |
| `bug_triage_medium` | `0.6715` |
| `bug_triage_hard` | `0.6460` |
| Mean | `0.7698` |

The score artifact is saved to `artifacts/baseline_scores.json`.

## Docker and Hugging Face

Build:

```bash
docker build -t bug-triage-openenv .
```

Run:

```bash
docker run --rm -p 7860:7860 bug-triage-openenv
```

This repo is set up for a Docker-based Hugging Face Space and tagged with `openenv`.