Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -1,10 +1,49 @@
|
|
| 1 |
-
--
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<p align="center" style="font-size: 1.4em; font-weight: bold;">
|
| 2 |
+
🖥️📱 UI-MOPD
|
| 3 |
+
</p>
|
| 4 |
+
|
| 5 |
+
<p align="center">
|
| 6 |
+
<b>Multi-platform On-Policy Distillation for Continual GUI Agent Learning</b>
|
| 7 |
+
</p>
|
| 8 |
+
|
| 9 |
+
<p>
|
| 10 |
+
We build cross-platform GUI agents that can operate both desktop and mobile interfaces through a unified training framework.
|
| 11 |
+
</p>
|
| 12 |
+
|
| 13 |
+
<h3>Research</h3>
|
| 14 |
+
|
| 15 |
+
<p>
|
| 16 |
+
UI-MOPD introduces a two-stage training pipeline:
|
| 17 |
+
</p>
|
| 18 |
+
<ul>
|
| 19 |
+
<li><b>Stage 1</b>: Supervised Fine-Tuning (SFT) on platform-specific teacher models</li>
|
| 20 |
+
<li><b>Stage 2</b>: Reinforcement Learning distillation (DAPO) with multi-teacher on-policy guidance</li>
|
| 21 |
+
</ul>
|
| 22 |
+
<p>
|
| 23 |
+
Our student model (8B) learns from multiple 32B teacher models to achieve strong cross-platform GUI interaction capabilities.
|
| 24 |
+
</p>
|
| 25 |
+
|
| 26 |
+
<h3>Models</h3>
|
| 27 |
+
|
| 28 |
+
<table>
|
| 29 |
+
<tr><th>Model</th><th>Size</th><th>Description</th></tr>
|
| 30 |
+
<tr><td><a href="https://huggingface.co/UI-MOPD/Qwen3-VL-32B-Thinking-Desktop-Teacher">Qwen3-VL-32B-Thinking-Desktop-Teacher</a></td><td>33B</td><td>Desktop platform teacher</td></tr>
|
| 31 |
+
<tr><td><a href="https://huggingface.co/UI-MOPD/Qwen3-VL-32B-Thinking-Mobile-Teacher">Qwen3-VL-32B-Thinking-Mobile-Teacher</a></td><td>33B</td><td>Mobile platform teacher</td></tr>
|
| 32 |
+
<tr><td><a href="https://huggingface.co/UI-MOPD/Qwen3-VL-8B-Thinking-Desktop-SFT">Qwen3-VL-8B-Thinking-Desktop-SFT</a></td><td>9B</td><td>Desktop SFT checkpoint</td></tr>
|
| 33 |
+
<tr><td><a href="https://huggingface.co/UI-MOPD/Qwen3-VL-8B-Thinking-Mobile-SFT">Qwen3-VL-8B-Thinking-Mobile-SFT</a></td><td>9B</td><td>Mobile SFT checkpoint</td></tr>
|
| 34 |
+
<tr><td><a href="https://huggingface.co/UI-MOPD/Qwen3-VL-8B-Thinking-UI-MOPD-Student">Qwen3-VL-8B-Thinking-UI-MOPD-Student</a></td><td>9B</td><td>Final cross-platform student</td></tr>
|
| 35 |
+
</table>
|
| 36 |
+
|
| 37 |
+
<h3>Datasets</h3>
|
| 38 |
+
|
| 39 |
+
<table>
|
| 40 |
+
<tr><th>Dataset</th><th>Description</th></tr>
|
| 41 |
+
<tr><td><a href="https://huggingface.co/datasets/UI-MOPD/Uni-GUI-OpenCUA">Uni-GUI-OpenCUA</a></td><td>Post-processed desktop trajectories from OpenCUA (~832 episodes, ~14K steps)</td></tr>
|
| 42 |
+
<tr><td><a href="https://huggingface.co/datasets/UI-MOPD/Uni-GUI-Desktop-1">Uni-GUI-Desktop-1</a></td><td>Large-scale desktop GUI trajectories (~2.7K episodes, ~36K steps)</td></tr>
|
| 43 |
+
</table>
|
| 44 |
+
|
| 45 |
+
<h3>Links</h3>
|
| 46 |
+
|
| 47 |
+
<ul>
|
| 48 |
+
<li><a href="https://elispctre.github.io/UI-MOPD">Project Page</a></li>
|
| 49 |
+
</ul>
|