Papers
arxiv:2610.20939

MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments

Published on Oct 14
· Submitted by
Quyu Kong
on Oct 16
Authors:
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

MAI-Gym is an open platform that unifies GUI agent evaluation, data collection, and online reinforcement learning training across mobile, computer, and web environments, enabling scalable synthesis of verified tasks and training of a unified 9B agent with state-of-the-art open performance.

Online reinforcement learning (RL) with verifiable rewards has driven rapid progress in mathematics, coding, and tool use, but scaling this success to GUI agents remains challenging due to the high cost of interactive environments and the scarcity of realistic training tasks. We introduce MAI-Gym, an open all-in-one platform that unifies GUI agent evaluation, data collection, and online RL training across mobile, computer, and web environments. Through a shared rollout pipeline, MAI-Gym ensures consistent agent behavior across evaluation and training, supports ten established benchmarks, and scales to 20,000 parallel environment instances. Beyond scalable infrastructure, MAI-Gym enables automated synthesis of diverse GUI applications and challenging tasks, including resettable mocked apps and coherent cross-app worlds with execution-validated task verifiers. Using MAI-Gym, we train MAI-Gym-9B, a unified 9B agent for mobile and computer use, achieving state-of-the-art performance among open GUI agents under 10B parameters: 78.4% on MobileWorld and 76.2% on OSWorld-Verified. Importantly, RL in a mocked train-ticketing app transfers to its real-world counterpart, improving task success on a phys- ical phone from 28.8% to 48.1%. We release the framework, synthesis skills, mocked apps, 2,000 verified tasks, and the model checkpoint to support repro- ducible research and further advances in scalable GUI agent training.

Community

Paper submitter

Excited to share MAI-Gym, our open platform for evaluating and training GUI agents across mobile, desktop, and web! 🚀

⚡ One-command evaluation and training
Run evaluations across 10 GUI benchmarks or launch large-scale online RL with a single command. Evaluation, data collection, and training share the same agent execution pipeline.

🧩 Apps, tasks, and verifiers in one workflow
MAI-Gym synthesizes resettable apps, cross-app tasks, and code-based verifiers, with task generation guided by model weaknesses. The release includes 49 simulated apps, 2,000 execution-verified tasks, and reusable synthesis skills.

🤖 MAI-Gym-9B: one model for mobile and desktop
Trained with joint online RL, it achieves 78.4% on MobileWorld and 76.2% on OSWorld-Verified—state-of-the-art results among open GUI agents under 10B parameters on both benchmarks.

We’re releasing the framework, synthesis skills, apps, tasks, and model weights to support reproducible research and help the community build better GUI agents. We’d love your feedback and contributions!

🌐 Project: tongyi-mai.github.io/MAI-Gym
🤗 Weights: huggingface.co/Tongyi-MAI/MAI-Gym-9B
📑 Report: arxiv.org/abs/2610.20939
💻 Code: github.com/Tongyi-MAI/MAI-Gym

Sign up or log in to comment

Models citing this paper 1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.20939 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.