Hugging Face's logo

Spaces:
BreakingWeb
/
README
Running

App Files Community
README
File size: 1,554 Bytes
b22123f
a9d4885
b22123f
 
 
a9d4885
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
title: BreakingWeb
sdk: static
---

# BreakingWeb

**Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions**

BreakingWeb evaluates browser agents on matched clean/intervention tasks across seven self-hosted web environments. The benchmark contains 519 task pairs and 29 intervention families. Each pair preserves the user instruction, latent target, and backend success criterion.

[Paper](https://arxiv.org/abs/2609.35814) 路 [Website](https://www.breakingweb.app/) 路 [Code](https://github.com/Arvid-pku/BreakingWeb) 路 [Live demo](https://tianchenguan-breakingweb-demo.hf.space)

## Evaluation artifacts

- [breakingweb-results-v2](https://huggingface.co/datasets/BreakingWeb/breakingweb-results-v2): Browser-Use trajectories for six models.
- [breakingweb-results-v3](https://huggingface.co/datasets/BreakingWeb/breakingweb-results-v3): additional Browser-Use runs and screenshot-only BrowserGym trajectories.

Each dataset card describes its contents and how to download the artifacts.

## Citation

```bibtex
@misc{yin2026constructingchallengingbrowserusetasks,
      title={Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions},
      author={Xunjian Yin and Tianchen Guan and Jinao Wang and Weili Cao and Daisy Xinlei Lin and Royce Cheng-Yue and Keagan Long and Kyle Wong and Bhuwan Dhingra and Xiangjun Wang and Shuyan Zhou},
      year={2026},
      eprint={2609.35814},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2609.35814},
}
```