Document intermediate SoccerTwos policy
Browse files
README.md
CHANGED
|
@@ -55,6 +55,8 @@ ccnets/causal-gpt-rl-unity/
|
|
| 55 |
pushblock.onnx
|
| 56 |
dungeon-escape/
|
| 57 |
dungeonescape-b36.onnx
|
|
|
|
|
|
|
| 58 |
README.md
|
| 59 |
```
|
| 60 |
|
|
@@ -126,6 +128,37 @@ agents (first episode each), measured closed-loop on a real Unity build.
|
|
| 126 |
Unity returns are engine- and build-specific; they are **not** comparable to the
|
| 127 |
Gymnasium / MuJoCo scores.
|
| 128 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 129 |
## DungeonEscape
|
| 130 |
|
| 131 |
| Policy | Ctx | Batch | Obs | Action | Agent return | Group success |
|
|
|
|
| 55 |
pushblock.onnx
|
| 56 |
dungeon-escape/
|
| 57 |
dungeonescape-b36.onnx
|
| 58 |
+
soccer-twos/
|
| 59 |
+
soccertwos-b16.onnx
|
| 60 |
README.md
|
| 61 |
```
|
| 62 |
|
|
|
|
| 128 |
Unity returns are engine- and build-specific; they are **not** comparable to the
|
| 129 |
Gymnasium / MuJoCo scores.
|
| 130 |
|
| 131 |
+
## SoccerTwos
|
| 132 |
+
|
| 133 |
+
| Policy | Ctx | Batch | Obs | Action | Side-swapped W/D/L | Win rate |
|
| 134 |
+
|---|---:|---:|---:|---|---:|---:|
|
| 135 |
+
| `soccer-twos/soccertwos-b16.onnx` | 32 | 16 | 336 | `MultiDiscrete([3,3,3])` logits | 4/0/12 | 25.00% |
|
| 136 |
+
|
| 137 |
+
This is an **approximately 50%-trained intermediate checkpoint** published to
|
| 138 |
+
complete and validate the adversarial multi-agent example. Performance is
|
| 139 |
+
provisional; the artifact and metrics will be replaced after training.
|
| 140 |
+
|
| 141 |
+
One release-23 scene contains eight independent 2-vs-2 fields. The Causal graph
|
| 142 |
+
controls both players on one team (`8 fields x 2 agents = 16` independent context
|
| 143 |
+
rows) while the stock ML-Agents ONNX controls the opponent team. The measurement
|
| 144 |
+
swaps sides: Causal-team-0 vs stock-team-1 and stock-team-0 vs Causal-team-1.
|
| 145 |
+
A same-seed stock-vs-stock smoke baseline produced 4/0/4 across the eight fields.
|
| 146 |
+
|
| 147 |
+
SoccerTwos ONNX contract:
|
| 148 |
+
|
| 149 |
+
| Input/output | Shape |
|
| 150 |
+
|---|---|
|
| 151 |
+
| `states` | `[16, 32, 336]` |
|
| 152 |
+
| `actions` | `[16, 32, 9]` (three one-hot branches) |
|
| 153 |
+
| `is_bos` | `[16, 32, 1]` |
|
| 154 |
+
| `mask` | `[16, 32]` |
|
| 155 |
+
| `action` | `[16, 9]` (three groups of three logits; `argmax` per branch) |
|
| 156 |
+
|
| 157 |
+
The public side-swapped evaluator and notebook are in
|
| 158 |
+
[`examples/unity`](https://github.com/ccnets-team/causal-gpt-rl/tree/main/examples/unity).
|
| 159 |
+
Batching is computational only; teammates do not cross-attend or share hidden
|
| 160 |
+
state.
|
| 161 |
+
|
| 162 |
## DungeonEscape
|
| 163 |
|
| 164 |
| Policy | Ctx | Batch | Obs | Action | Agent return | Group success |
|