Move evaluation results to top of model card
Browse files
README.md
CHANGED
|
@@ -14,55 +14,6 @@ tags:
|
|
| 14 |
|
| 15 |
> A 9B agentic model trained from interactions generated inside runtimes deployed across real office and software-development workflows.
|
| 16 |
|
| 17 |
-
## Overview
|
| 18 |
-
|
| 19 |
-
O2-9B-Preview is a 9B-parameter preview model developed by Ant International and initialized from Qwen3.5-9B. It is designed for agentic reasoning, tool use, and coding.
|
| 20 |
-
|
| 21 |
-
The defining feature of O2-9B-Preview is where its post-training experience comes from. Instead of relying only on static prompt-response datasets, we deployed an executable agent runtime in real operational environments—including international merchant customer-service workflows and the daily development workflows of dozens of engineers—and trained the model from the resulting interactions.
|
| 22 |
-
|
| 23 |
-
Within these runtimes, the model acts on a task, observes the consequence, receives an executable verification result, and, when necessary, repairs its action. These student-visited states are preserved as structured training records and distilled back into the model. O2-9B-Preview is therefore trained not only on what a successful answer looks like, but also on what happened when an action was executed, why it failed, and how it was repaired.
|
| 24 |
-
|
| 25 |
-
## What Makes O2 Different
|
| 26 |
-
|
| 27 |
-
### Trained where agents actually work
|
| 28 |
-
|
| 29 |
-
The training loop is connected to deployed office and development environments rather than an isolated text-only data pipeline. It captures interactions with tools, repositories, tests, workflow state, and domain rules under the same kinds of conditions in which agents are expected to operate.
|
| 30 |
-
|
| 31 |
-
### Learning from executable outcomes
|
| 32 |
-
|
| 33 |
-
For each task, the runtime constructs a task-conditioned verifier suite that checks observable evidence such as tool results, environment state, code execution, repository tests, schema constraints, and domain rules. A verifier pass is treated as a certificate under a specific, versioned suite—not as unrestricted ground truth.
|
| 34 |
-
|
| 35 |
-
### Preserving failures and repairs
|
| 36 |
-
|
| 37 |
-
The runtime records the task context, model action, executed consequence, verifier outcome, localized failure feedback, and repaired action when one exists. Accepted, rejected, repaired, and unresolved attempts remain available for learning instead of discarding everything except the final answer.
|
| 38 |
-
|
| 39 |
-
### Runtime on-policy distillation
|
| 40 |
-
|
| 41 |
-
O2-9B-Preview is post-trained with Runtime OPSD, an on-policy sequence-distillation recipe over states visited by the student in the deployed runtime. Oracle outcomes anchor complete trajectories, while teacher and student score tokens under the same task context, runtime state, and generated prefix. This keeps the learning signal aligned with the information available to the model at inference time.
|
| 42 |
-
|
| 43 |
-
## Training Loop
|
| 44 |
-
|
| 45 |
-
1. A task and its runtime profile are compiled into a versioned verifier suite.
|
| 46 |
-
2. The model acts in the executable task environment.
|
| 47 |
-
3. The runtime checks the resulting state and returns an auditable outcome.
|
| 48 |
-
4. Failed obligations produce localized, failure-only feedback for bounded repair.
|
| 49 |
-
5. The interaction is stored as a versioned training record, including failures and repair transitions.
|
| 50 |
-
6. Runtime OPSD distills these student-visited records into the next model checkpoint.
|
| 51 |
-
|
| 52 |
-
This process turns deployed task environments into a renewable source of grounded training experience.
|
| 53 |
-
|
| 54 |
-
## Model Details
|
| 55 |
-
|
| 56 |
-
| Field | Description |
|
| 57 |
-
| --- | --- |
|
| 58 |
-
| Model | O2-9B-Preview |
|
| 59 |
-
| Developer | Ant International |
|
| 60 |
-
| Parameters | 9B |
|
| 61 |
-
| Base model | Qwen3.5-9B |
|
| 62 |
-
| Training paradigm | Verifier-guided runtime data synthesis and Runtime OPSD |
|
| 63 |
-
| Primary capability groups | Reasoning, tool use, and coding |
|
| 64 |
-
| Release stage | Preview |
|
| 65 |
-
|
| 66 |
## Preliminary Evaluation
|
| 67 |
|
| 68 |
O2-9B-Preview was evaluated across eleven reasoning, tool-use, and coding benchmarks. We report its same-size Qwen3.5-9B base alongside larger O2 checkpoints and cross-scale reference models. Scores are shown on their original scales, and higher is better. The average is the unweighted mean of the eleven displayed benchmarks.
|
|
@@ -208,6 +159,55 @@ O2-9B-Preview improves ten of the eleven reported point estimates over the base
|
|
| 208 |
|
| 209 |
These results are preliminary. They come from an author-provided evaluation report without repeated seeds, uncertainty intervals, or matched training and runtime-compute budgets. They characterize the released checkpoint but do not isolate the causal contribution of any individual training component.
|
| 210 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 211 |
## Intended Use
|
| 212 |
|
| 213 |
O2-9B-Preview is intended for research and evaluation involving:
|
|
|
|
| 14 |
|
| 15 |
> A 9B agentic model trained from interactions generated inside runtimes deployed across real office and software-development workflows.
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
## Preliminary Evaluation
|
| 18 |
|
| 19 |
O2-9B-Preview was evaluated across eleven reasoning, tool-use, and coding benchmarks. We report its same-size Qwen3.5-9B base alongside larger O2 checkpoints and cross-scale reference models. Scores are shown on their original scales, and higher is better. The average is the unweighted mean of the eleven displayed benchmarks.
|
|
|
|
| 159 |
|
| 160 |
These results are preliminary. They come from an author-provided evaluation report without repeated seeds, uncertainty intervals, or matched training and runtime-compute budgets. They characterize the released checkpoint but do not isolate the causal contribution of any individual training component.
|
| 161 |
|
| 162 |
+
## Overview
|
| 163 |
+
|
| 164 |
+
O2-9B-Preview is a 9B-parameter preview model developed by Ant International and initialized from Qwen3.5-9B. It is designed for agentic reasoning, tool use, and coding.
|
| 165 |
+
|
| 166 |
+
The defining feature of O2-9B-Preview is where its post-training experience comes from. Instead of relying only on static prompt-response datasets, we deployed an executable agent runtime in real operational environments—including international merchant customer-service workflows and the daily development workflows of dozens of engineers—and trained the model from the resulting interactions.
|
| 167 |
+
|
| 168 |
+
Within these runtimes, the model acts on a task, observes the consequence, receives an executable verification result, and, when necessary, repairs its action. These student-visited states are preserved as structured training records and distilled back into the model. O2-9B-Preview is therefore trained not only on what a successful answer looks like, but also on what happened when an action was executed, why it failed, and how it was repaired.
|
| 169 |
+
|
| 170 |
+
## What Makes O2 Different
|
| 171 |
+
|
| 172 |
+
### Trained where agents actually work
|
| 173 |
+
|
| 174 |
+
The training loop is connected to deployed office and development environments rather than an isolated text-only data pipeline. It captures interactions with tools, repositories, tests, workflow state, and domain rules under the same kinds of conditions in which agents are expected to operate.
|
| 175 |
+
|
| 176 |
+
### Learning from executable outcomes
|
| 177 |
+
|
| 178 |
+
For each task, the runtime constructs a task-conditioned verifier suite that checks observable evidence such as tool results, environment state, code execution, repository tests, schema constraints, and domain rules. A verifier pass is treated as a certificate under a specific, versioned suite—not as unrestricted ground truth.
|
| 179 |
+
|
| 180 |
+
### Preserving failures and repairs
|
| 181 |
+
|
| 182 |
+
The runtime records the task context, model action, executed consequence, verifier outcome, localized failure feedback, and repaired action when one exists. Accepted, rejected, repaired, and unresolved attempts remain available for learning instead of discarding everything except the final answer.
|
| 183 |
+
|
| 184 |
+
### Runtime on-policy distillation
|
| 185 |
+
|
| 186 |
+
O2-9B-Preview is post-trained with Runtime OPSD, an on-policy sequence-distillation recipe over states visited by the student in the deployed runtime. Oracle outcomes anchor complete trajectories, while teacher and student score tokens under the same task context, runtime state, and generated prefix. This keeps the learning signal aligned with the information available to the model at inference time.
|
| 187 |
+
|
| 188 |
+
## Training Loop
|
| 189 |
+
|
| 190 |
+
1. A task and its runtime profile are compiled into a versioned verifier suite.
|
| 191 |
+
2. The model acts in the executable task environment.
|
| 192 |
+
3. The runtime checks the resulting state and returns an auditable outcome.
|
| 193 |
+
4. Failed obligations produce localized, failure-only feedback for bounded repair.
|
| 194 |
+
5. The interaction is stored as a versioned training record, including failures and repair transitions.
|
| 195 |
+
6. Runtime OPSD distills these student-visited records into the next model checkpoint.
|
| 196 |
+
|
| 197 |
+
This process turns deployed task environments into a renewable source of grounded training experience.
|
| 198 |
+
|
| 199 |
+
## Model Details
|
| 200 |
+
|
| 201 |
+
| Field | Description |
|
| 202 |
+
| --- | --- |
|
| 203 |
+
| Model | O2-9B-Preview |
|
| 204 |
+
| Developer | Ant International |
|
| 205 |
+
| Parameters | 9B |
|
| 206 |
+
| Base model | Qwen3.5-9B |
|
| 207 |
+
| Training paradigm | Verifier-guided runtime data synthesis and Runtime OPSD |
|
| 208 |
+
| Primary capability groups | Reasoning, tool use, and coding |
|
| 209 |
+
| Release stage | Preview |
|
| 210 |
+
|
| 211 |
## Intended Use
|
| 212 |
|
| 213 |
O2-9B-Preview is intended for research and evaluation involving:
|