Spaces:
Running
Running
| title: BreakingWeb | |
| sdk: static | |
| # BreakingWeb | |
| **Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions** | |
| BreakingWeb evaluates browser agents on matched clean/intervention tasks across seven self-hosted web environments. The benchmark contains 519 task pairs and 29 intervention families. Each pair preserves the user instruction, latent target, and backend success criterion. | |
| [Paper](https://arxiv.org/abs/2609.35814) 路 [Website](https://www.breakingweb.app/) 路 [Code](https://github.com/Arvid-pku/BreakingWeb) 路 [Live demo](https://tianchenguan-breakingweb-demo.hf.space) | |
| ## Evaluation artifacts | |
| - [breakingweb-results-v2](https://huggingface.co/datasets/BreakingWeb/breakingweb-results-v2): Browser-Use trajectories for six models. | |
| - [breakingweb-results-v3](https://huggingface.co/datasets/BreakingWeb/breakingweb-results-v3): additional Browser-Use runs and screenshot-only BrowserGym trajectories. | |
| Each dataset card describes its contents and how to download the artifacts. | |
| ## Citation | |
| ```bibtex | |
| @misc{yin2026constructingchallengingbrowserusetasks, | |
| title={Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions}, | |
| author={Xunjian Yin and Tianchen Guan and Jinao Wang and Weili Cao and Daisy Xinlei Lin and Royce Cheng-Yue and Keagan Long and Kyle Wong and Bhuwan Dhingra and Xiangjun Wang and Shuyan Zhou}, | |
| year={2026}, | |
| eprint={2609.35814}, | |
| archivePrefix={arXiv}, | |
| primaryClass={cs.CL}, | |
| url={https://arxiv.org/abs/2609.35814}, | |
| } | |
| ``` | |