Yooki commited on
Commit
d9c0075
·
verified ·
1 Parent(s): d8883ad

Move evaluation results to top of model card

Browse files
Files changed (1) hide show
  1. README.md +49 -49
README.md CHANGED
@@ -14,55 +14,6 @@ tags:
14
 
15
  > A 9B agentic model trained from interactions generated inside runtimes deployed across real office and software-development workflows.
16
 
17
- ## Overview
18
-
19
- O2-9B-Preview is a 9B-parameter preview model developed by Ant International and initialized from Qwen3.5-9B. It is designed for agentic reasoning, tool use, and coding.
20
-
21
- The defining feature of O2-9B-Preview is where its post-training experience comes from. Instead of relying only on static prompt-response datasets, we deployed an executable agent runtime in real operational environments—including international merchant customer-service workflows and the daily development workflows of dozens of engineers—and trained the model from the resulting interactions.
22
-
23
- Within these runtimes, the model acts on a task, observes the consequence, receives an executable verification result, and, when necessary, repairs its action. These student-visited states are preserved as structured training records and distilled back into the model. O2-9B-Preview is therefore trained not only on what a successful answer looks like, but also on what happened when an action was executed, why it failed, and how it was repaired.
24
-
25
- ## What Makes O2 Different
26
-
27
- ### Trained where agents actually work
28
-
29
- The training loop is connected to deployed office and development environments rather than an isolated text-only data pipeline. It captures interactions with tools, repositories, tests, workflow state, and domain rules under the same kinds of conditions in which agents are expected to operate.
30
-
31
- ### Learning from executable outcomes
32
-
33
- For each task, the runtime constructs a task-conditioned verifier suite that checks observable evidence such as tool results, environment state, code execution, repository tests, schema constraints, and domain rules. A verifier pass is treated as a certificate under a specific, versioned suite—not as unrestricted ground truth.
34
-
35
- ### Preserving failures and repairs
36
-
37
- The runtime records the task context, model action, executed consequence, verifier outcome, localized failure feedback, and repaired action when one exists. Accepted, rejected, repaired, and unresolved attempts remain available for learning instead of discarding everything except the final answer.
38
-
39
- ### Runtime on-policy distillation
40
-
41
- O2-9B-Preview is post-trained with Runtime OPSD, an on-policy sequence-distillation recipe over states visited by the student in the deployed runtime. Oracle outcomes anchor complete trajectories, while teacher and student score tokens under the same task context, runtime state, and generated prefix. This keeps the learning signal aligned with the information available to the model at inference time.
42
-
43
- ## Training Loop
44
-
45
- 1. A task and its runtime profile are compiled into a versioned verifier suite.
46
- 2. The model acts in the executable task environment.
47
- 3. The runtime checks the resulting state and returns an auditable outcome.
48
- 4. Failed obligations produce localized, failure-only feedback for bounded repair.
49
- 5. The interaction is stored as a versioned training record, including failures and repair transitions.
50
- 6. Runtime OPSD distills these student-visited records into the next model checkpoint.
51
-
52
- This process turns deployed task environments into a renewable source of grounded training experience.
53
-
54
- ## Model Details
55
-
56
- | Field | Description |
57
- | --- | --- |
58
- | Model | O2-9B-Preview |
59
- | Developer | Ant International |
60
- | Parameters | 9B |
61
- | Base model | Qwen3.5-9B |
62
- | Training paradigm | Verifier-guided runtime data synthesis and Runtime OPSD |
63
- | Primary capability groups | Reasoning, tool use, and coding |
64
- | Release stage | Preview |
65
-
66
  ## Preliminary Evaluation
67
 
68
  O2-9B-Preview was evaluated across eleven reasoning, tool-use, and coding benchmarks. We report its same-size Qwen3.5-9B base alongside larger O2 checkpoints and cross-scale reference models. Scores are shown on their original scales, and higher is better. The average is the unweighted mean of the eleven displayed benchmarks.
@@ -208,6 +159,55 @@ O2-9B-Preview improves ten of the eleven reported point estimates over the base
208
 
209
  These results are preliminary. They come from an author-provided evaluation report without repeated seeds, uncertainty intervals, or matched training and runtime-compute budgets. They characterize the released checkpoint but do not isolate the causal contribution of any individual training component.
210
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
211
  ## Intended Use
212
 
213
  O2-9B-Preview is intended for research and evaluation involving:
 
14
 
15
  > A 9B agentic model trained from interactions generated inside runtimes deployed across real office and software-development workflows.
16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ## Preliminary Evaluation
18
 
19
  O2-9B-Preview was evaluated across eleven reasoning, tool-use, and coding benchmarks. We report its same-size Qwen3.5-9B base alongside larger O2 checkpoints and cross-scale reference models. Scores are shown on their original scales, and higher is better. The average is the unweighted mean of the eleven displayed benchmarks.
 
159
 
160
  These results are preliminary. They come from an author-provided evaluation report without repeated seeds, uncertainty intervals, or matched training and runtime-compute budgets. They characterize the released checkpoint but do not isolate the causal contribution of any individual training component.
161
 
162
+ ## Overview
163
+
164
+ O2-9B-Preview is a 9B-parameter preview model developed by Ant International and initialized from Qwen3.5-9B. It is designed for agentic reasoning, tool use, and coding.
165
+
166
+ The defining feature of O2-9B-Preview is where its post-training experience comes from. Instead of relying only on static prompt-response datasets, we deployed an executable agent runtime in real operational environments—including international merchant customer-service workflows and the daily development workflows of dozens of engineers—and trained the model from the resulting interactions.
167
+
168
+ Within these runtimes, the model acts on a task, observes the consequence, receives an executable verification result, and, when necessary, repairs its action. These student-visited states are preserved as structured training records and distilled back into the model. O2-9B-Preview is therefore trained not only on what a successful answer looks like, but also on what happened when an action was executed, why it failed, and how it was repaired.
169
+
170
+ ## What Makes O2 Different
171
+
172
+ ### Trained where agents actually work
173
+
174
+ The training loop is connected to deployed office and development environments rather than an isolated text-only data pipeline. It captures interactions with tools, repositories, tests, workflow state, and domain rules under the same kinds of conditions in which agents are expected to operate.
175
+
176
+ ### Learning from executable outcomes
177
+
178
+ For each task, the runtime constructs a task-conditioned verifier suite that checks observable evidence such as tool results, environment state, code execution, repository tests, schema constraints, and domain rules. A verifier pass is treated as a certificate under a specific, versioned suite—not as unrestricted ground truth.
179
+
180
+ ### Preserving failures and repairs
181
+
182
+ The runtime records the task context, model action, executed consequence, verifier outcome, localized failure feedback, and repaired action when one exists. Accepted, rejected, repaired, and unresolved attempts remain available for learning instead of discarding everything except the final answer.
183
+
184
+ ### Runtime on-policy distillation
185
+
186
+ O2-9B-Preview is post-trained with Runtime OPSD, an on-policy sequence-distillation recipe over states visited by the student in the deployed runtime. Oracle outcomes anchor complete trajectories, while teacher and student score tokens under the same task context, runtime state, and generated prefix. This keeps the learning signal aligned with the information available to the model at inference time.
187
+
188
+ ## Training Loop
189
+
190
+ 1. A task and its runtime profile are compiled into a versioned verifier suite.
191
+ 2. The model acts in the executable task environment.
192
+ 3. The runtime checks the resulting state and returns an auditable outcome.
193
+ 4. Failed obligations produce localized, failure-only feedback for bounded repair.
194
+ 5. The interaction is stored as a versioned training record, including failures and repair transitions.
195
+ 6. Runtime OPSD distills these student-visited records into the next model checkpoint.
196
+
197
+ This process turns deployed task environments into a renewable source of grounded training experience.
198
+
199
+ ## Model Details
200
+
201
+ | Field | Description |
202
+ | --- | --- |
203
+ | Model | O2-9B-Preview |
204
+ | Developer | Ant International |
205
+ | Parameters | 9B |
206
+ | Base model | Qwen3.5-9B |
207
+ | Training paradigm | Verifier-guided runtime data synthesis and Runtime OPSD |
208
+ | Primary capability groups | Reasoning, tool use, and coding |
209
+ | Release stage | Preview |
210
+
211
  ## Intended Use
212
 
213
  O2-9B-Preview is intended for research and evaluation involving: