Spaces:
Running
Running
File size: 2,152 Bytes
085a012 e18eb21 085a012 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 |
---
title: OpenHands Index
emoji: 🤖
colorFrom: blue
colorTo: purple
sdk: docker
app_file: app.py
pinned: true
license: apache-2.0
hf_oauth: true
app_port: 7860
failure_strategy: none
tags:
- leaderboard
---
## OpenHands Index Leaderboard
This leaderboard tracks agent performance across multiple software engineering and AI benchmarks.
<!-- Updated: 2025-11-24 - Data loading fix deployed -->
## Development
The leaderboard is built using the [HuggingFace Datasets](https://huggingface.co/docs/datasets/index) library, which provides a convenient way to manage and query datasets.
Results are sourced from the [OpenHands Index Results](https://github.com/OpenHands/openhands-index-results) repository.
To run the leaderboard locally first make sure to set this env variable:
```bash
export IS_INTERNAL=true
```
You can then start it up with the following command:
```bash
python app.py
```
This will start a local server that you can access in your web browser at `http://localhost:7860`.
## Hugging Face Integration
The repo backs two Hugging Face leaderboard spaces:
- https://huggingface.co/spaces/allenai/asta-bench-internal-leaderboard
- https://huggingface.co/spaces/allenai/asta-bench-leaderboard
Please follow the steps below to push changes to the leaderboards on Hugging Face.
Before pushing, make sure to merge your changes to the `main` branch of this repository. (following the standard GitHub workflow of creating a branch, making changes, and then merging it back to `main`).
Before pushing for the first time, you'll need to add the Hugging Face remote repositories if you haven't done so already. You can do this by running the following commands:
```bash
git remote add huggingface https://huggingface.co/spaces/allenai/asta-bench-internal-leaderboard
git remote add huggingface-public https://huggingface.co/spaces/allenai/asta-bench-leaderboard
```
You can verify that the remotes have been added by running:
```bash
git remote -v
```
Then, to push the changes to the Hugging Face leaderboards, you can use the following commands:
```bash
git push huggingface main:main
git push huggingface-public main:main
```
|