ForgeOwl-8B / README.md
mobileforge-anonymous's picture
Publish sanitized anonymous files
20616ae verified
|
Raw
History Blame Contribute Delete
1.73 kB
---
license: mit
base_model: mPLUG/GUI-Owl-1.5-8B-Instruct
library_name: transformers
pipeline_tag: image-text-to-text
tags:
- mobile-gui
- vision-language-model
- anonymous-submission
---
# ForgeOwl-8B
ForgeOwl-8B is the GUI-Owl-1.5-8B-Instruct policy adapted with MobileForge on `900` automatically generated target-app tasks. MobileForge uses the policy's own rollouts, hierarchical critic feedback, corrective hints, and hint-contextualized step-level GRPO. No human-written adaptation tasks, demonstrations, or reward labels are used.
This repository is part of an anonymous ICLR submission artifact. Author and paper-identifying metadata will be added after review.
Anonymous project page: https://mobileforge-anonymous.github.io/
## Evaluation
On AndroidWorld (`116` tasks), this checkpoint obtains `78/116` (`67.2%`) Pass@1, `87/116` (`75.0%`) Pass@2, and `90/116` (`77.6%`) Pass@3. On the MobileWorld GUI-only split (`117` tasks), it obtains `48/117` (`41.0%`) success rate.
Reproduction code and raw evaluation archives are available from the [anonymous code repository](https://github.com/mobileforge-anonymous/MobileForge) and [benchmark-results dataset](https://huggingface.co/datasets/mobileforge-anonymous/mobileforge-benchmark-results).
## Usage
Use the same loading and prompting interface as [`mPLUG/GUI-Owl-1.5-8B-Instruct`](https://huggingface.co/mPLUG/GUI-Owl-1.5-8B-Instruct). See the anonymous code repository for AndroidWorld and MobileWorld runners.
## Limitations
The model can make incorrect or unsafe GUI actions. Run it only in isolated test environments, inspect actions before using it with personal data, and do not treat benchmark success as evidence of general reliability.