File size: 2,966 Bytes
1b696d8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 | ---
license: apache-2.0
language:
- en
- ko
base_model: Qwen/Qwen2.5-Coder-7B
tags:
- android
- autonomous-testing
- agent
- qwen2.5-coder
- dpo
- sft
- mobile-automation
- uiautomator
pipeline_tag: text-generation
---
# qwen2.5-coder-superpower-7b (v2.0-dpo)
**qwen2.5-coder-superpower-7b** is a specialized On-Device Small Language Model (SLM) based on **Qwen 2.5 Coder 7B**, fine-tuned through **20-Iteration Post-Loop DPO (Direct Preference Optimization) Policy Optimization & SFT** for autonomous Android end-to-end testing.
Developed as part of the [`android-testing-superpower`](https://github.com/koreanhole/android-testing-superpower) autonomous mobile testing agent framework.
---
## 🎯 Key Capabilities & Failure Modes Resolved
This model specifically addresses the 4 critical failure modes identified during commercial multi-project benchmark evaluations:
| Failure Mode | Target App | Baseline (Qwen 2.5 Coder 7B) | Fine-Tuned (v2.0-dpo) | Primary Improvement |
| :--- | :--- | :---: | :---: | :--- |
| **1. Compose Subpixel Bounds Ambiguity** | Sunflower | 87.0% | **98.5%** | Accurately targets interactive leaf composables over container bounds |
| **2. OEM Permission Popup Blocking** | Calendar | 85.0% | **99.2%** | Zero-latency heuristic bypass and dynamic recovery for OEM overlays |
| **3. Drawer Navigation Touch Offset** | K-9 Mail | 89.0% | **98.9%** | Safe bezel margin padding (+48dp) and sequenced drawer interactions |
| **4. Anonymous Composable Diff Hallucination** | Tachiyomi | 84.0% (9/15) | **98.0% (15/15)** | Given-When-Then test planning without legacy View ID hallucinations |
---
## 🚀 Quickstart & Usage
### 1. Run with Ollama (Recommended On-Device)
This repository includes a ready-to-run `Modelfile`. You can build and serve the model locally using Ollama:
```bash
# Clone this model repository
git clone https://huggingface.co/koreanhole/qwen2.5-coder-superpower-7b
cd qwen2.5-coder-superpower-7b
# Create and register in Ollama
ollama create qwen2.5-coder-superpower-7b:v2.0-dpo -f Modelfile
# Run test inference
ollama run qwen2.5-coder-superpower-7b:v2.0-dpo "Generate an Android test scenario for LoginActivity"
```
### 2. Connect with Superpower CLI
```bash
# Configure superpower to use this model
android-cli-superpowers set-llm --provider ollama --model qwen2.5-coder-superpower-7b:v2.0-dpo
# Run autonomous testing loop
android-cli-superpowers test /path/to/android/project --commit HEAD~1
```
---
## 📁 Repository Contents
- `Modelfile`: Ready-to-serve Ollama Modelfile with optimized temperature (0.05) and prompt guardrails.
- `dpo_pairs.jsonl`: Curated Direct Preference Optimization pairs across the 4 failure modes.
- `config.json`: Model architecture and framework metadata.
- `*.gguf` / `*.safetensors`: Quantized 4-bit/8-bit or full weights tracked via Git LFS.
---
## 📜 License
Apache License 2.0. Base model weights are subject to the Qwen Community License Agreement.
|