kissin42 commited on
Commit
f91fc80
·
verified ·
1 Parent(s): 224aa98

Document intermediate SoccerTwos policy

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -55,6 +55,8 @@ ccnets/causal-gpt-rl-unity/
55
  pushblock.onnx
56
  dungeon-escape/
57
  dungeonescape-b36.onnx
 
 
58
  README.md
59
  ```
60
 
@@ -126,6 +128,37 @@ agents (first episode each), measured closed-loop on a real Unity build.
126
  Unity returns are engine- and build-specific; they are **not** comparable to the
127
  Gymnasium / MuJoCo scores.
128
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
129
  ## DungeonEscape
130
 
131
  | Policy | Ctx | Batch | Obs | Action | Agent return | Group success |
 
55
  pushblock.onnx
56
  dungeon-escape/
57
  dungeonescape-b36.onnx
58
+ soccer-twos/
59
+ soccertwos-b16.onnx
60
  README.md
61
  ```
62
 
 
128
  Unity returns are engine- and build-specific; they are **not** comparable to the
129
  Gymnasium / MuJoCo scores.
130
 
131
+ ## SoccerTwos
132
+
133
+ | Policy | Ctx | Batch | Obs | Action | Side-swapped W/D/L | Win rate |
134
+ |---|---:|---:|---:|---|---:|---:|
135
+ | `soccer-twos/soccertwos-b16.onnx` | 32 | 16 | 336 | `MultiDiscrete([3,3,3])` logits | 4/0/12 | 25.00% |
136
+
137
+ This is an **approximately 50%-trained intermediate checkpoint** published to
138
+ complete and validate the adversarial multi-agent example. Performance is
139
+ provisional; the artifact and metrics will be replaced after training.
140
+
141
+ One release-23 scene contains eight independent 2-vs-2 fields. The Causal graph
142
+ controls both players on one team (`8 fields x 2 agents = 16` independent context
143
+ rows) while the stock ML-Agents ONNX controls the opponent team. The measurement
144
+ swaps sides: Causal-team-0 vs stock-team-1 and stock-team-0 vs Causal-team-1.
145
+ A same-seed stock-vs-stock smoke baseline produced 4/0/4 across the eight fields.
146
+
147
+ SoccerTwos ONNX contract:
148
+
149
+ | Input/output | Shape |
150
+ |---|---|
151
+ | `states` | `[16, 32, 336]` |
152
+ | `actions` | `[16, 32, 9]` (three one-hot branches) |
153
+ | `is_bos` | `[16, 32, 1]` |
154
+ | `mask` | `[16, 32]` |
155
+ | `action` | `[16, 9]` (three groups of three logits; `argmax` per branch) |
156
+
157
+ The public side-swapped evaluator and notebook are in
158
+ [`examples/unity`](https://github.com/ccnets-team/causal-gpt-rl/tree/main/examples/unity).
159
+ Batching is computational only; teammates do not cross-attend or share hidden
160
+ state.
161
+
162
  ## DungeonEscape
163
 
164
  | Policy | Ctx | Batch | Obs | Action | Agent return | Group success |