k4ng commited on
Commit
14bc40b
·
verified ·
1 Parent(s): 59d5d61

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +89 -0
README.md ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: other
5
+ library_name: transformers
6
+ pipeline_tag: image-text-to-text
7
+ base_model: Qwen/Qwen3.5-9B
8
+ datasets:
9
+ - AI45Research/SATraj-OS
10
+ tags:
11
+ - computer-use-agent
12
+ - gui-agent
13
+ - multimodal
14
+ - supervised-fine-tuning
15
+ - safety
16
+ - osworld
17
+ - os-blind
18
+ ---
19
+
20
+ # SCOPE-SFT-9B
21
+
22
+ **SCOPE-SFT-9B** is a computer-use agent (CUA) trained under the SCOPE (Safety and Capability Optimization for Policy Execution) framework to balance task-execution capability with safety-aware decision-making. The model is initialized from **Qwen3.5-9B** and jointly fine-tuned on capability demonstrations, safe-continuation trajectories, and explicit-refusal trajectories.
23
+
24
+ In our evaluation, SCOPE-SFT-9B achieves a **49.72%** task success rate on OSWorld and a **66.30%** attack-avoidance rate on OS-BLIND, corresponding to a capability-safety harmonic mean of **56.83%**.
25
+
26
+ SCOPE-SFT-9B is trained on SATraj-OS using joint supervised fine-tuning. Capability demonstrations teach the model to complete benign desktop tasks, while safe-continuation and explicit-refusal trajectories teach it to respond appropriately when a request or execution environment presents a safety risk. SCOPE-SFT-9B also serves as the initialization checkpoint for SCOPE-RL-9B.
27
+
28
+ ## Links
29
+
30
+ - Paper: [Beyond Task Completion: Training Capable and Safe Computer-Use Agents]()
31
+ - Training dataset: [SATraj-OS](https://huggingface.co/datasets/AI45Research/SATraj-OS)
32
+ - Data and safety framework: [Safactory](https://github.com/AI45Lab/SAfactory)
33
+ - Model collection: [SCOPE](https://huggingface.co/collections/k4ng/scope)
34
+
35
+ ## Quick Start
36
+
37
+ Install vLLM:
38
+
39
+ ```bash
40
+ pip install -U vllm
41
+ ```
42
+
43
+ Launch an OpenAI-compatible inference server:
44
+
45
+ ```bash
46
+ vllm serve k4ng/SCOPE-SFT-9B \
47
+ --host 0.0.0.0 \
48
+ --port 8000 \
49
+ --tensor-parallel-size 1 \
50
+ --data-parallel-size 2 \
51
+ --trust-remote-code \
52
+ --served-model-name scope-sft
53
+ ```
54
+
55
+ ## Results
56
+
57
+ | Type | Model | H ↑ | OSWorld ↑ | OS-BLIND ↑ |
58
+ |---|---|---:|---:|---:|
59
+ | Closed-source | Claude 4.5 Sonnet | 37.78 | 62.90 | 27.00 |
60
+ | Closed-source | Qwen3.7-Plus | 9.36 | **73.33** | 5.00 |
61
+ | Open-source | EvoCUA-8B | 10.62 | 46.06 | 6.00 |
62
+ | Open-source | EvoCUA-32B | 4.42 | 56.73 | 2.30 |
63
+ | Open-source | OpenCUA-7B | 3.21 | 28.85 | 1.70 |
64
+ | Open-source | OpenCUA-32B | 1.94 | 34.79 | 1.00 |
65
+ | Open-source | OpenCUA-72B | 4.38 | 44.99 | 2.30 |
66
+ | Open-source | UI-TARS-1.5-7B | 8.46 | 27.52 | 5.00 |
67
+ | Open-source | ComputerRL | 21.77 | 48.90 | 14.00 |
68
+ | Open-source | Qwen3.5-9B | 8.93 | 41.80 | 5.00 |
69
+ | Open-source | Qwen3-VL-8B | 16.27 | 33.90 | 10.70 |
70
+ | SCOPE | **SCOPE-SFT-9B** | 56.83 | 49.72 | **66.30** |
71
+ | SCOPE | SCOPE-RL-9B | **58.80** | **54.17** | 64.30 |
72
+
73
+ All values are percentages, and ↑ indicates that higher is better. \(H\) is the harmonic mean of the OSWorld task success rate and the OS-BLIND attack-avoidance rate. Compared with the intermediate SFT checkpoint, SCOPE-SFT-9B improves OSWorld performance by 4.29 percentage points and attack avoidance by 13.97 points. The harmonic mean increases from 48.64% to 56.83%.
74
+
75
+ ## License
76
+
77
+ This model is subject to the license terms of its base model, Qwen3.5-9B. Licensing information for the code and training data is available in the corresponding repositories.
78
+
79
+ ## Citation
80
+
81
+ If you use SCOPE-RL, SCOPE-SFT, SATraj-OS, or SCOPE-Gen, please cite:
82
+
83
+ ```bibtex
84
+ @misc{kang2026scope,
85
+ title = {Beyond Task Completion: Training Capable and Safe Computer-Use Agents},
86
+ author = {Zeyu Kang and Zhenyun Yin and Yang Zhang and Shan He and Shanzhe Lei and Yanjiu Zhong and Xinquan Chen and Xuhong Wang},
87
+ year = {2026}
88
+ }
89
+ ```