Corning commited on
Commit
a9d4885
路
verified 路
1 Parent(s): b22123f

Add BreakingWeb project overview

Browse files
Files changed (1) hide show
  1. README.md +29 -6
README.md CHANGED
@@ -1,10 +1,33 @@
1
  ---
2
- title: README
3
- emoji: 馃弮
4
- colorFrom: gray
5
- colorTo: green
6
  sdk: static
7
- pinned: false
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: BreakingWeb
 
 
 
3
  sdk: static
 
4
  ---
5
 
6
+ # BreakingWeb
7
+
8
+ **Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions**
9
+
10
+ BreakingWeb evaluates browser agents on matched clean/intervention tasks across seven self-hosted web environments. The benchmark contains 519 task pairs and 29 intervention families. Each pair preserves the user instruction, latent target, and backend success criterion.
11
+
12
+ [Paper](https://arxiv.org/abs/2609.35814) 路 [Website](https://www.breakingweb.app/) 路 [Code](https://github.com/Arvid-pku/BreakingWeb) 路 [Live demo](https://tianchenguan-breakingweb-demo.hf.space)
13
+
14
+ ## Evaluation artifacts
15
+
16
+ - [breakingweb-results-v2](https://huggingface.co/datasets/BreakingWeb/breakingweb-results-v2): Browser-Use trajectories for six models.
17
+ - [breakingweb-results-v3](https://huggingface.co/datasets/BreakingWeb/breakingweb-results-v3): additional Browser-Use runs and screenshot-only BrowserGym trajectories.
18
+
19
+ Each dataset card describes its contents and how to download the artifacts.
20
+
21
+ ## Citation
22
+
23
+ ```bibtex
24
+ @misc{yin2026constructingchallengingbrowserusetasks,
25
+ title={Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions},
26
+ author={Xunjian Yin and Tianchen Guan and Jinao Wang and Weili Cao and Daisy Xinlei Lin and Royce Cheng-Yue and Keagan Long and Kyle Wong and Bhuwan Dhingra and Xiangjun Wang and Shuyan Zhou},
27
+ year={2026},
28
+ eprint={2609.35814},
29
+ archivePrefix={arXiv},
30
+ primaryClass={cs.CL},
31
+ url={https://arxiv.org/abs/2609.35814},
32
+ }
33
+ ```