README.md

---
title: OpenHands Index
emoji: 🤖
colorFrom: yellow
colorTo: yellow
sdk: docker
app_file: app.py
pinned: true
license: apache-2.0
hf_oauth: true
app_port: 7860
failure_strategy: none
tags:
  - leaderboard
thumbnail: https://huggingface.co/spaces/OpenHands/openhands-index/resolve/main/assets/openhands-index-preview.jpg
short_description: A Holistic Benchmark for Software Engineering
---

## OpenHands Index Leaderboard

This leaderboard tracks agent performance across multiple software engineering and AI benchmarks.

<!-- Updated: 2025-11-24 - Data loading fix deployed -->

## Development
The leaderboard is built using the [HuggingFace Datasets](https://huggingface.co/docs/datasets/index) library, which provides a convenient way to manage and query datasets.
Results are sourced from the [OpenHands Index Results](https://github.com/OpenHands/openhands-index-results) repository.

To run the leaderboard locally first make sure to set this env variable:
```bash
export IS_INTERNAL=true
```
You can then start it up with the following command:
```bash
python app.py
```
This will start a local server that you can access in your web browser at `http://localhost:7860`.

## Hugging Face Integration
The repo backs the Hugging Face space at https://huggingface.co/spaces/OpenHands/openhands-index

Please follow the steps below to push changes to the leaderboard on Hugging Face.

Before pushing, make sure to merge your changes to the `main` branch of this repository (following the standard GitHub workflow of creating a branch, making changes, and then merging it back to `main`).

Then, to push the changes to the Hugging Face leaderboard:

```bash
git push origin main
```