README.md

metadata

title: Bug Triage OpenEnv
colorFrom: blue
colorTo: green
sdk: docker
app_port: 7860
tags:
  - openenv

Bug Triage OpenEnv

A simple OpenEnv environment for real-world software bug triage. The agent must classify tickets, assign them to the right team, detect duplicates, request missing information, and escalate urgent incidents.

Why this environment

This is a real workflow, not a toy task. Software teams do bug triage every day, and progress can be measured step by step.

The environment includes:

• Typed Observation, Action, Reward, and State models with Pydantic
• Standard OpenEnv methods: reset(), step(), and state()
• Three deterministic tasks: easy, medium, and hard
• Programmatic graders with scores in [0.0, 1.0]
• Dense rewards for partial progress

Observation and action space

Observation includes:

• Current ticket details
• Queue stats
• Available teams and components
• Steps used and remaining
• Partial score and last action result

Actions supported:

• classify
• assign
• mark_duplicate
• request_info
• defer
• close
• escalate_incident
• next_ticket

Tasks

bug_triage_easy

• Difficulty: easy
• 8 tickets
• Mostly clear bug reports with minimal duplicates

bug_triage_medium

• Difficulty: medium
• 15 tickets
• Mixed-quality reports with duplicates and missing information

bug_triage_hard

• Difficulty: hard
• 25 tickets
• Noisy tickets with SLA pressure and escalation trade-offs

Reward and grading

The reward function gives feedback during the episode, not only at the end.

It rewards:

• Correct severity, priority, and component classification
• Correct team assignment
• Correct duplicate handling
• Correct information requests
• Correct escalation of critical tickets

It penalizes:

• Invalid actions
• Repeated loop behavior
• Missing escalation on critical tickets
• Incorrect close or defer decisions

Each task has a deterministic grader in openenv_bug_triage/grader.py.

Setup

Install dependencies:

python -m venv venv

Windows PowerShell:

venv\Scripts\Activate.ps1
pip install -r requirements.txt

macOS/Linux:

source venv/bin/activate
pip install -r requirements.txt

Validate:

openenv validate

Run locally

Start the API:

uvicorn server.app:app --host 0.0.0.0 --port 7860

Main endpoints:

• GET /reset
• POST /reset
• POST /step
• GET /state
• GET /tasks
• GET /health

Baseline inference

Submission runner:

python inference.py

Deterministic offline baseline:

$env:OPENENV_OFFLINE = "1"
venv\Scripts\python.exe scripts\baseline_inference.py --offline --seed 42

Current offline baseline scores:

Task	Score
bug_triage_easy	0.9920
bug_triage_medium	0.6715
bug_triage_hard	0.6460
Mean	0.7698

The score artifact is saved to artifacts/baseline_scores.json.

Docker and Hugging Face

Build:

docker build -t bug-triage-openenv .

Run:

docker run --rm -p 7860:7860 bug-triage-openenv

This repo is set up for a Docker-based Hugging Face Space and tagged with openenv.