Add model card and metadata for ClawGUI-2B
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,31 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: image-text-to-text
|
| 4 |
+
library_name: transformers
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
# ClawGUI-2B
|
| 8 |
+
|
| 9 |
+
**ClawGUI-2B** is a 2B-parameter multimodal GUI agent trained as part of the [ClawGUI framework](https://github.com/zju-real/ClawGUI). It is designed to interact with software through visual interfaces by predicting actions such as taps, swipes, and keystrokes directly from screenshots and natural language instructions.
|
| 10 |
+
|
| 11 |
+
## Resources
|
| 12 |
+
- **Paper:** [ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents](https://huggingface.co/papers/2604.11784)
|
| 13 |
+
- **GitHub Repository:** [ZJU-REAL/ClawGUI](https://github.com/zju-real/ClawGUI)
|
| 14 |
+
- **Project Page:** [https://zju-real.github.io/ClawGUI-Page](https://zju-real.github.io/ClawGUI-Page)
|
| 15 |
+
|
| 16 |
+
## Model Description
|
| 17 |
+
ClawGUI-2B is trained end-to-end within the ClawGUI pipeline using **GiGPO** (a variation of GRPO) and a **Process Reward Model (PRM)** to provide dense step-level supervision. This training methodology allows the agent to reach high levels of stability and performance across different environments, including virtual emulators and real physical devices.
|
| 18 |
+
|
| 19 |
+
In benchmark evaluations, ClawGUI-2B achieves a **17.1% Success Rate** on the MobileWorld GUI-Only benchmark, outperforming the MAI-UI-2B baseline of the same scale by 6.0%.
|
| 20 |
+
|
| 21 |
+
## Citation
|
| 22 |
+
If you find ClawGUI useful in your research, please cite:
|
| 23 |
+
|
| 24 |
+
```bibtex
|
| 25 |
+
@article{tang2026clawgui,
|
| 26 |
+
title={ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents},
|
| 27 |
+
author={Fei Tang and Zhiqiong Lu and Boxuan Zhang and Weiming Lu and Jun Xiao and Yueting Zhuang and Yongliang Shen},
|
| 28 |
+
journal={arXiv preprint arXiv:2604.11784},
|
| 29 |
+
year={2026}
|
| 30 |
+
}
|
| 31 |
+
```
|