Hugging Face's logo

ziadbc
/
teeunit-agent

Reinforcement Learning
English
custom
q-learning
game-ai
teeworlds
openenv
Eval Results (legacy)
Model card Files
xet
Community
ziadbc commited on
Commit
868f2dd
·
1 Parent(s): 9f1799f

feat: add Q-Learning agent trained on teeunit-env Space

Browse files

- New Q-Learning agent (20 episodes, 938 steps, 39.38 total reward)
- JSON and pickle formats for easy loading
- Comprehensive README with usage examples
- Links to HF Space and GitHub repo

Trained on: https://huggingface.co/spaces/ziadbc/teeunit-env

Files changed (5) hide show
  1. README.md +147 -0
  2. final_model.zip +0 -3
  3. teeunit_ppo_10000_steps.zip +0 -3
  4. teeunit_qlearning_agent.json +1519 -0
  5. teeunit_qlearning_agent.pkl +0 -0
README.md ADDED
@@ -0,0 +1,147 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # TeeUnit Agent
2
+
3
+ Trained RL agents for the [TeeUnit Environment](https://huggingface.co/spaces/ziadbc/teeunit-env) - an OpenEnv-compatible Teeworlds arena for LLM-based reinforcement learning.
4
+
5
+ ## Environment
6
+
7
+ - **Space**: [ziadbc/teeunit-env](https://huggingface.co/spaces/ziadbc/teeunit-env)
8
+ - **GitHub**: [ziadgit/teeunit](https://github.com/ziadgit/teeunit)
9
+ - **Game**: Teeworlds 0.7.5 arena (simulation mode)
10
+
11
+ ## Available Models
12
+
13
+ ### Q-Learning Agent (Latest)
14
+ - **File**: `teeunit_qlearning_agent.json` / `teeunit_qlearning_agent.pkl`
15
+ - **Algorithm**: Tabular Q-Learning
16
+ - **Training**: 20 episodes, 938 steps
17
+ - **Total Reward**: 39.38
18
+
19
+ ### Actions
20
+ The agent can perform 7 actions:
21
+ | Action | Description |
22
+ |--------|-------------|
23
+ | `move left` | Move character left |
24
+ | `move right` | Move character right |
25
+ | `move none` | Stop moving |
26
+ | `jump` | Jump |
27
+ | `shoot pistol` | Fire pistol (weapon 1) |
28
+ | `shoot shotgun` | Fire shotgun (weapon 2) |
29
+ | `hook` | Use grappling hook |
30
+
31
+ ## Usage
32
+
33
+ ### Load and Use the Agent
34
+
35
+ ```python
36
+ import json
37
+ import random
38
+
39
+ # Load model
40
+ with open('teeunit_qlearning_agent.json') as f:
41
+ model = json.load(f)
42
+
43
+ q_table = model['q_table']
44
+ actions = model['actions']
45
+
46
+ def get_state_key(status_text):
47
+ """Extract state from game status text."""
48
+ lines = status_text.split('\n')
49
+ state = []
50
+ for line in lines:
51
+ if 'Position:' in line:
52
+ try:
53
+ pos = line.split('(')[1].split(')')[0]
54
+ x, y = map(float, pos.split(','))
55
+ state.append(f'pos_{int(x//100)}_{int(y//100)}')
56
+ except:
57
+ state.append('pos_unknown')
58
+ if 'Health:' in line:
59
+ try:
60
+ health = int(line.split(':')[1].split('/')[0].strip())
61
+ state.append(f'hp_{health//3}')
62
+ except:
63
+ pass
64
+ if 'units away' in line:
65
+ try:
66
+ dist = float(line.split(',')[-1].replace('units away', '').strip())
67
+ state.append(f'enemy_{"close" if dist < 100 else "mid" if dist < 200 else "far"}')
68
+ except:
69
+ pass
70
+ return str(tuple(sorted(state))) if state else "('default',)"
71
+
72
+ def choose_action(state_key):
73
+ """Choose best action for given state."""
74
+ if state_key in q_table:
75
+ q_values = q_table[state_key]
76
+ best_action = max(q_values.keys(), key=lambda a: q_values[a])
77
+ return int(best_action)
78
+ return random.randint(0, len(actions) - 1)
79
+
80
+ # Example usage
81
+ state_key = get_state_key(status_text)
82
+ action_idx = choose_action(state_key)
83
+ action = actions[action_idx]
84
+ print(f"Action: {action['tool']} with args {action['args']}")
85
+ ```
86
+
87
+ ### Connect to Environment
88
+
89
+ ```python
90
+ import asyncio
91
+ import websockets
92
+ import json
93
+
94
+ async def play():
95
+ uri = 'wss://ziadbc-teeunit-env.hf.space/ws'
96
+
97
+ async with websockets.connect(uri) as ws:
98
+ # Reset environment
99
+ await ws.send(json.dumps({'type': 'reset', 'data': {}}))
100
+ await ws.recv()
101
+
102
+ # Get status
103
+ await ws.send(json.dumps({
104
+ 'type': 'step',
105
+ 'data': {'type': 'call_tool', 'tool_name': 'get_status', 'arguments': {}}
106
+ }))
107
+ resp = json.loads(await ws.recv())
108
+ status = resp['data']['observation']['result']['data']
109
+
110
+ # Choose and execute action
111
+ state_key = get_state_key(status)
112
+ action = actions[choose_action(state_key)]
113
+
114
+ await ws.send(json.dumps({
115
+ 'type': 'step',
116
+ 'data': {'type': 'call_tool', 'tool_name': action['tool'], 'arguments': action['args']}
117
+ }))
118
+ resp = json.loads(await ws.recv())
119
+ reward = resp['data']['reward']
120
+ print(f"Reward: {reward}")
121
+
122
+ asyncio.run(play())
123
+ ```
124
+
125
+ ## Training Your Own Agent
126
+
127
+ See the [Colab notebook](https://github.com/ziadgit/teeunit/blob/main/notebooks/teeunit_training.ipynb) for training examples using:
128
+ - **Q-Learning** (tabular)
129
+ - **Stable Baselines3** (PPO, A2C)
130
+ - **Unsloth/TRL** (LLM fine-tuning)
131
+
132
+ ## Environment API
133
+
134
+ The TeeUnit environment exposes these MCP tools:
135
+
136
+ | Tool | Arguments | Description |
137
+ |------|-----------|-------------|
138
+ | `move` | `direction: "left"\|"right"\|"none"` | Move horizontally |
139
+ | `jump` | - | Jump (can double-jump) |
140
+ | `aim` | `x: int, y: int` | Aim at coordinates |
141
+ | `shoot` | `weapon: 0-5` | Fire weapon |
142
+ | `hook` | - | Toggle grappling hook |
143
+ | `get_status` | - | Get game state as text |
144
+
145
+ ## License
146
+
147
+ MIT License - See [GitHub repo](https://github.com/ziadgit/teeunit) for details.
final_model.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:33a7572889347cc59a2b040aa30cbeb55fa05e82f26b4c27dca6684819e87fcf
3
- size 7491538
 
 
 
 
teeunit_ppo_10000_steps.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:adb293d58f7226920ad3a0996e0533ff369ba38d3248ae4a12db8af8cf83cbf0
3
- size 7491537
 
 
 
 
teeunit_qlearning_agent.json ADDED
@@ -0,0 +1,1519 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "algorithm": "Q-Learning",
3
+ "environment": "ziadbc/teeunit-env",
4
+ "trained_at": "2026-03-08T10:56:29.785554",
5
+ "episodes": 20,
6
+ "steps": 938,
7
+ "total_reward": 39.38000000000003,
8
+ "actions": [
9
+ {
10
+ "tool": "move",
11
+ "args": {
12
+ "direction": "left"
13
+ }
14
+ },
15
+ {
16
+ "tool": "move",
17
+ "args": {
18
+ "direction": "right"
19
+ }
20
+ },
21
+ {
22
+ "tool": "move",
23
+ "args": {
24
+ "direction": "none"
25
+ }
26
+ },
27
+ {
28
+ "tool": "jump",
29
+ "args": {}
30
+ },
31
+ {
32
+ "tool": "shoot",
33
+ "args": {
34
+ "weapon": 1
35
+ }
36
+ },
37
+ {
38
+ "tool": "shoot",
39
+ "args": {
40
+ "weapon": 2
41
+ }
42
+ },
43
+ {
44
+ "tool": "hook",
45
+ "args": {}
46
+ }
47
+ ],
48
+ "q_table": {
49
+ "('enemy_close', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_3')": {
50
+ "6": 0.009469134627691268,
51
+ "0": 0.0,
52
+ "1": 0.0,
53
+ "2": 0.0,
54
+ "3": 0.0,
55
+ "4": 0.0,
56
+ "5": 0.0
57
+ },
58
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_3')": {
59
+ "6": 0.0060994729826249995,
60
+ "0": 0.0,
61
+ "1": 0.0,
62
+ "2": 0.0014354270612500003,
63
+ "3": 0.0,
64
+ "4": 0.0014354270612500003,
65
+ "5": 0.0
66
+ },
67
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_6_3')": {
68
+ "2": 0.0019000000000000002,
69
+ "0": 0.0,
70
+ "1": 0.0,
71
+ "3": 0.0,
72
+ "4": 0.0,
73
+ "5": 0.0,
74
+ "6": 0.0
75
+ },
76
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_6_3')": {
77
+ "3": 0.004950249375625001,
78
+ "0": 0.0,
79
+ "1": 0.0,
80
+ "2": 0.0,
81
+ "4": 0.0,
82
+ "5": 0.001,
83
+ "6": 0.0
84
+ },
85
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_6_2')": {
86
+ "2": 0.008353226940779229,
87
+ "0": 0.001189525,
88
+ "1": 0.0,
89
+ "3": 0.0012835773750000002,
90
+ "4": 0.002625493328184375,
91
+ "5": 0.0,
92
+ "6": 0.0
93
+ },
94
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_6_1')": {
95
+ "4": 0.003403321409077521,
96
+ "0": 0.0,
97
+ "1": 0.0,
98
+ "2": 0.0,
99
+ "3": 0.0,
100
+ "5": 0.0,
101
+ "6": 0.0
102
+ },
103
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_6_1')": {
104
+ "3": 0.016252138779852113,
105
+ "0": 0.0,
106
+ "1": 0.0013582611155625,
107
+ "2": 0.0,
108
+ "4": 0.0,
109
+ "5": 0.0,
110
+ "6": 0.0
111
+ },
112
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_6_0')": {
113
+ "6": 0.001,
114
+ "1": 0.014925116973446905,
115
+ "0": 0.0,
116
+ "2": 0.0,
117
+ "3": 0.0011985048750000002,
118
+ "4": 0.0,
119
+ "5": 0.0
120
+ },
121
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_7_0')": {
122
+ "3": 0.0188005703720386,
123
+ "0": 0.0032682148915153773,
124
+ "1": 0.0,
125
+ "2": 0.0,
126
+ "4": 0.0016463060906228733,
127
+ "5": 0.0014702736906843752,
128
+ "6": 0.0
129
+ },
130
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_7_-1')": {
131
+ "1": 0.04037445812756561,
132
+ "0": 0.010111221173019479,
133
+ "2": 0.0,
134
+ "3": 0.0,
135
+ "4": 0.0037772246706651255,
136
+ "5": 0.0036823474354472155,
137
+ "6": 0.0014702736906843752
138
+ },
139
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_3')": {
140
+ "6": 0.001,
141
+ "4": 0.006089149498329344,
142
+ "0": 0.001,
143
+ "1": 0.0,
144
+ "2": 0.0,
145
+ "3": 0.0,
146
+ "5": 0.001
147
+ },
148
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_4')": {
149
+ "5": 0.0027955000000000002,
150
+ "0": 0.0,
151
+ "1": 0.0,
152
+ "2": 0.0,
153
+ "3": 0.0,
154
+ "4": 0.0,
155
+ "6": 0.0
156
+ },
157
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_4')": {
158
+ "4": 0.001
159
+ },
160
+ "('enemy_mid', 'hp_3', 'pos_2_4')": {
161
+ "0": 0.0027955000000000002,
162
+ "1": 0.0,
163
+ "2": 0.0,
164
+ "3": 0.0,
165
+ "4": 0.0,
166
+ "5": 0.0,
167
+ "6": 0.0
168
+ },
169
+ "('enemy_mid', 'hp_3', 'pos_1_5')": {
170
+ "5": 0.0036865225000000004,
171
+ "0": 0.0,
172
+ "1": 0.0,
173
+ "2": 0.0,
174
+ "3": 0.0,
175
+ "4": 0.0,
176
+ "6": 0.0
177
+ },
178
+ "('hp_3', 'pos_0_5')": {
179
+ "1": 1.0010000000000001
180
+ },
181
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_2')": {
182
+ "1": 0.001,
183
+ "2": 0.016090238314915517,
184
+ "0": 0.0,
185
+ "3": 0.0,
186
+ "4": 0.0021805560779033133,
187
+ "5": 0.0,
188
+ "6": 0.0
189
+ },
190
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_2')": {
191
+ "6": 0.011040468537489273,
192
+ "0": 0.0,
193
+ "1": 0.0,
194
+ "2": 0.0,
195
+ "3": 0.0018017594567444882,
196
+ "4": 0.0,
197
+ "5": 0.0
198
+ },
199
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_3')": {
200
+ "1": 0.00846899094180844,
201
+ "0": 0.0,
202
+ "2": 0.0,
203
+ "3": 0.0,
204
+ "4": 0.0,
205
+ "5": 0.0,
206
+ "6": 0.0
207
+ },
208
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_3')": {
209
+ "3": 0.007194301532993241,
210
+ "0": 0.0,
211
+ "1": 0.0,
212
+ "2": 0.0,
213
+ "4": 0.0,
214
+ "5": 0.0,
215
+ "6": 0.0
216
+ },
217
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_3')": {
218
+ "6": 0.006345725562881251,
219
+ "0": 0.0,
220
+ "1": 0.0,
221
+ "2": 0.0,
222
+ "3": 0.0,
223
+ "4": 0.0,
224
+ "5": 0.001
225
+ },
226
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_4_3')": {
227
+ "1": 0.0019000000000000002,
228
+ "0": 0.0,
229
+ "2": 0.0,
230
+ "3": 0.0,
231
+ "4": 0.0,
232
+ "5": 0.0,
233
+ "6": 0.0
234
+ },
235
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_2')": {
236
+ "3": 0.0028905000000000003,
237
+ "0": 0.0,
238
+ "1": 0.0,
239
+ "2": 0.001,
240
+ "4": 0.0,
241
+ "5": 0.0,
242
+ "6": 0.0
243
+ },
244
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_2')": {
245
+ "5": 0.004573089887500001,
246
+ "0": 0.0,
247
+ "1": 0.0,
248
+ "2": 0.0,
249
+ "3": 0.0,
250
+ "4": 0.0,
251
+ "6": 0.0
252
+ },
253
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_6_2')": {
254
+ "4": 0.001,
255
+ "0": 0.005092609233124027,
256
+ "1": 0.0,
257
+ "2": 0.0,
258
+ "3": 0.0,
259
+ "5": 0.0,
260
+ "6": 0.0
261
+ },
262
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_2')": {
263
+ "6": 0.004950249375625001,
264
+ "0": 0.0,
265
+ "1": 0.0,
266
+ "2": 0.0,
267
+ "3": 0.0,
268
+ "4": 0.001,
269
+ "5": 0.0
270
+ },
271
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_5_2')": {
272
+ "2": 0.001,
273
+ "3": 0.001
274
+ },
275
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_4_2')": {
276
+ "6": 0.014037585612700982,
277
+ "0": 0.0,
278
+ "1": 0.0021552196375,
279
+ "2": 0.0,
280
+ "3": 0.0,
281
+ "4": 0.0,
282
+ "5": 0.0
283
+ },
284
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_3_2')": {
285
+ "6": 0.011445712450502781,
286
+ "0": 0.0,
287
+ "1": 0.001,
288
+ "2": 0.0,
289
+ "3": 0.0,
290
+ "4": 0.0,
291
+ "5": 0.0
292
+ },
293
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_4_2')": {
294
+ "5": 0.004950249375625001,
295
+ "0": 0.0,
296
+ "1": 0.0,
297
+ "2": 0.001,
298
+ "3": 0.0013771594881250003,
299
+ "4": 0.0,
300
+ "6": 0.0
301
+ },
302
+ "('enemy_close', 'enemy_far', 'enemy_far', 'hp_3', 'pos_4_2')": {
303
+ "0": 0.0019000000000000002,
304
+ "1": 0.0,
305
+ "2": 0.0,
306
+ "3": 0.0,
307
+ "4": 0.0,
308
+ "5": 0.0,
309
+ "6": 0.0
310
+ },
311
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_4_2')": {
312
+ "4": 0.002089525,
313
+ "0": 0.0,
314
+ "1": 0.0,
315
+ "2": 0.0,
316
+ "3": 0.0,
317
+ "5": 0.0,
318
+ "6": 0.0
319
+ },
320
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_1')": {
321
+ "1": 0.0019000000000000002
322
+ },
323
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_4_1')": {
324
+ "1": 0.005455224438062501,
325
+ "0": 0.0,
326
+ "2": 0.0,
327
+ "3": 0.0,
328
+ "4": 0.001,
329
+ "5": 0.0,
330
+ "6": 0.0
331
+ },
332
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_4_1')": {
333
+ "3": 0.001
334
+ },
335
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_5_1')": {
336
+ "2": 0.012039182244899372,
337
+ "0": 0.0,
338
+ "1": 0.0015182463216159377,
339
+ "3": 0.0,
340
+ "4": 0.0,
341
+ "5": 0.0,
342
+ "6": 0.0
343
+ },
344
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_5_0')": {
345
+ "6": 0.0015182463216159377
346
+ },
347
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_2')": {
348
+ "3": 0.007347652122957158,
349
+ "0": 0.0,
350
+ "1": 0.0,
351
+ "2": 0.0,
352
+ "4": 0.0,
353
+ "5": 0.0014568110914766003,
354
+ "6": 0.0
355
+ },
356
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_1')": {
357
+ "3": 0.0019000000000000002,
358
+ "0": 0.0,
359
+ "1": 0.0,
360
+ "2": 0.0,
361
+ "4": 0.0,
362
+ "5": 0.0,
363
+ "6": 0.0
364
+ },
365
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_3_1')": {
366
+ "4": 0.0027955000000000002,
367
+ "0": 0.0,
368
+ "1": 0.0,
369
+ "2": 0.0,
370
+ "3": 0.0,
371
+ "5": 0.0,
372
+ "6": 0.0
373
+ },
374
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_3_1')": {
375
+ "3": 0.0019000000000000002,
376
+ "0": 0.0,
377
+ "1": 0.0,
378
+ "2": 0.0,
379
+ "4": 0.0,
380
+ "5": 0.0,
381
+ "6": 0.0
382
+ },
383
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_3_0')": {
384
+ "4": 0.008939875895639257,
385
+ "0": 0.0,
386
+ "1": 0.0,
387
+ "2": 0.0,
388
+ "3": 0.003318981126926729,
389
+ "5": 0.0,
390
+ "6": 0.0018380980112063664
391
+ },
392
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_3_-1')": {
393
+ "0": 0.0027955000000000002,
394
+ "1": 0.0,
395
+ "2": 0.0,
396
+ "3": 0.0,
397
+ "4": 0.0,
398
+ "5": 0.0,
399
+ "6": 0.0
400
+ },
401
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_2_-1')": {
402
+ "3": 0.006446793033568751,
403
+ "0": 0.0015272713216159376,
404
+ "1": 0.0,
405
+ "2": 0.0,
406
+ "4": 0.0,
407
+ "5": 0.0,
408
+ "6": 0.0
409
+ },
410
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_1_-1')": {
411
+ "1": 0.0040358935393125,
412
+ "2": 0.001095,
413
+ "0": 0.0,
414
+ "3": 0.0,
415
+ "4": 0.0,
416
+ "5": 0.0,
417
+ "6": 0.0
418
+ },
419
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_1_-2')": {
420
+ "4": 0.0027955000000000002,
421
+ "0": 0.0,
422
+ "1": 0.0,
423
+ "2": 0.0,
424
+ "3": 0.0,
425
+ "5": 0.0,
426
+ "6": 0.0
427
+ },
428
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_2_-2')": {
429
+ "2": 0.0057298219380625005,
430
+ "0": 0.0012835773750000002,
431
+ "1": 0.0,
432
+ "3": 0.0,
433
+ "4": 0.0015443330841159377,
434
+ "5": 0.0,
435
+ "6": 0.0
436
+ },
437
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_3')": {
438
+ "6": 0.0011805000000000001
439
+ },
440
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_4')": {
441
+ "4": 0.008539737645753012,
442
+ "0": 0.0017043831114980862,
443
+ "1": 0.0,
444
+ "2": 0.0,
445
+ "3": 0.0,
446
+ "5": 0.0,
447
+ "6": 0.0
448
+ },
449
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_6_4')": {
450
+ "2": 0.0028036225,
451
+ "5": 0.001095,
452
+ "0": 0.0,
453
+ "1": 0.0,
454
+ "3": 0.0,
455
+ "4": 0.0,
456
+ "6": 0.0
457
+ },
458
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_6_4')": {
459
+ "2": 0.004573089887500001,
460
+ "0": 0.0012835773750000002,
461
+ "1": 0.0,
462
+ "3": 0.0,
463
+ "4": 0.0,
464
+ "5": 0.0,
465
+ "6": 0.0
466
+ },
467
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_6_5')": {
468
+ "5": 0.0019000000000000002,
469
+ "0": 0.0,
470
+ "1": 0.0,
471
+ "2": 0.0,
472
+ "3": 0.0,
473
+ "4": 0.0,
474
+ "6": 0.0
475
+ },
476
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_6_5')": {
477
+ "5": 0.00448844275,
478
+ "0": 0.0,
479
+ "1": 0.0,
480
+ "2": 0.0,
481
+ "3": 0.0,
482
+ "4": 0.0,
483
+ "6": 0.0
484
+ },
485
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_6_5')": {
486
+ "3": 0.001
487
+ },
488
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_6_4')": {
489
+ "0": 0.0019000000000000002,
490
+ "1": 0.0,
491
+ "2": 0.0,
492
+ "3": 0.0,
493
+ "4": 0.0,
494
+ "5": 0.0,
495
+ "6": 0.0
496
+ },
497
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_5_4')": {
498
+ "5": 0.0019000000000000002,
499
+ "0": 0.0,
500
+ "1": 0.0,
501
+ "2": 0.0,
502
+ "3": 0.0,
503
+ "4": 0.0,
504
+ "6": 0.0
505
+ },
506
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_5_4')": {
507
+ "5": 0.0019000000000000002,
508
+ "0": 0.0,
509
+ "1": 0.0,
510
+ "2": 0.0,
511
+ "3": 0.0,
512
+ "4": 0.0,
513
+ "6": 0.0
514
+ },
515
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_5_3')": {
516
+ "1": 0.001
517
+ },
518
+ "('enemy_close', 'enemy_mid', 'hp_3', 'pos_5_3')": {
519
+ "3": 0.0019950000000000002,
520
+ "0": 0.0,
521
+ "1": 0.0,
522
+ "2": 0.0,
523
+ "4": 0.0,
524
+ "5": 0.0,
525
+ "6": 0.001
526
+ },
527
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_3')": {
528
+ "3": 0.001
529
+ },
530
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_5_3')": {
531
+ "3": 0.001,
532
+ "2": 0.001,
533
+ "1": 0.001
534
+ },
535
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_5_2')": {
536
+ "1": 0.001,
537
+ "2": 0.001095,
538
+ "5": 0.01177388315228993,
539
+ "0": 0.0,
540
+ "3": 0.0012933611733093751,
541
+ "4": 0.0,
542
+ "6": 0.0
543
+ },
544
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_3')": {
545
+ "1": 0.001095,
546
+ "6": 0.001113857963125
547
+ },
548
+ "('enemy_close', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_3')": {
549
+ "6": 0.001,
550
+ "5": 0.0019855000000000003,
551
+ "4": 0.001,
552
+ "0": 0.0,
553
+ "1": 0.0,
554
+ "2": 0.0,
555
+ "3": 0.0
556
+ },
557
+ "('enemy_close', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_2')": {
558
+ "4": 0.001,
559
+ "0": 0.00466865017375,
560
+ "1": 0.0,
561
+ "2": 0.0,
562
+ "3": 0.0,
563
+ "5": 0.0,
564
+ "6": 0.0
565
+ },
566
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_3_2')": {
567
+ "5": 0.001,
568
+ "0": 0.006490476067517585,
569
+ "1": 0.0012146282405625002,
570
+ "2": 0.0,
571
+ "3": 0.0,
572
+ "4": 0.0,
573
+ "6": 0.0012146282405625002
574
+ },
575
+ "('enemy_close', 'enemy_far', 'enemy_far', 'hp_3', 'pos_3_2')": {
576
+ "2": 0.0013582611155625
577
+ },
578
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_2_3')": {
579
+ "3": 0.0027955000000000002,
580
+ "0": 0.0,
581
+ "1": 0.0,
582
+ "2": 0.0,
583
+ "4": 0.0,
584
+ "5": 0.0,
585
+ "6": 0.0
586
+ },
587
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_2_2')": {
588
+ "4": 0.007583443062417828,
589
+ "0": 0.0,
590
+ "1": 0.0,
591
+ "2": 0.0,
592
+ "3": 0.0,
593
+ "5": 0.0,
594
+ "6": 0.0
595
+ },
596
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_2_2')": {
597
+ "4": 0.005455224438062501,
598
+ "0": 0.0,
599
+ "1": 0.0013771594881250003,
600
+ "2": 0.0,
601
+ "3": 0.0026166030274375005,
602
+ "5": 0.0,
603
+ "6": 0.0
604
+ },
605
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_2_1')": {
606
+ "5": 0.001
607
+ },
608
+ "('hp_3', 'pos_2_1')": {
609
+ "2": 1.0010000000000001
610
+ },
611
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_2')": {
612
+ "5": 0.005296280898750001,
613
+ "0": 0.0,
614
+ "1": 0.0,
615
+ "2": 0.0,
616
+ "3": 0.0,
617
+ "4": 0.0,
618
+ "6": 0.0
619
+ },
620
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_2')": {
621
+ "3": 0.004573089887500001,
622
+ "0": 0.0,
623
+ "1": 0.0,
624
+ "2": 0.001189525,
625
+ "4": 0.0,
626
+ "5": 0.0,
627
+ "6": 0.0
628
+ },
629
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_1')": {
630
+ "0": 0.0019000000000000002,
631
+ "1": 0.0,
632
+ "2": 0.0,
633
+ "3": 0.0,
634
+ "4": 0.0,
635
+ "5": 0.0,
636
+ "6": 0.0
637
+ },
638
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_4_1')": {
639
+ "5": 0.001
640
+ },
641
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_3_1')": {
642
+ "3": 0.004573089887500001,
643
+ "0": 0.0,
644
+ "1": 0.0,
645
+ "2": 0.0,
646
+ "4": 0.0,
647
+ "5": 0.0,
648
+ "6": 0.0
649
+ },
650
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_3_0')": {
651
+ "2": 0.0036865225000000004,
652
+ "0": 0.0,
653
+ "1": 0.0,
654
+ "3": 0.0,
655
+ "4": 0.0,
656
+ "5": 0.0,
657
+ "6": 0.0
658
+ },
659
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_2_0')": {
660
+ "5": 0.001
661
+ },
662
+ "('enemy_far', 'hp_3', 'pos_2_0')": {
663
+ "5": 0.0072062835742928285,
664
+ "0": 0.0,
665
+ "1": 0.0,
666
+ "2": 0.0013771594881250003,
667
+ "3": 0.0,
668
+ "4": 0.0016551077106197985,
669
+ "6": 0.0
670
+ },
671
+ "('enemy_far', 'hp_3', 'pos_2_1')": {
672
+ "2": 0.004573089887500001,
673
+ "0": 0.0,
674
+ "1": 0.0,
675
+ "3": 0.0,
676
+ "4": 0.0,
677
+ "5": 0.0,
678
+ "6": 0.0
679
+ },
680
+ "('enemy_far', 'hp_3', 'pos_2_2')": {
681
+ "0": 0.001,
682
+ "4": 0.0028805725000000003,
683
+ "1": 0.0,
684
+ "2": 0.0,
685
+ "3": 0.0,
686
+ "5": 0.0,
687
+ "6": 0.0
688
+ },
689
+ "('enemy_mid', 'hp_3', 'pos_2_3')": {
690
+ "3": 0.001,
691
+ "6": 0.0028805725000000003,
692
+ "0": 0.0,
693
+ "1": 0.0,
694
+ "2": 0.0,
695
+ "4": 0.0,
696
+ "5": 0.0
697
+ },
698
+ "('enemy_mid', 'hp_3', 'pos_2_2')": {
699
+ "5": 0.006332948315872189,
700
+ "0": 0.0,
701
+ "1": 0.0,
702
+ "2": 0.0,
703
+ "3": 0.0,
704
+ "4": 0.0,
705
+ "6": 0.0
706
+ },
707
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_4')": {
708
+ "2": 0.006090201994256251,
709
+ "0": 0.0,
710
+ "1": 0.0,
711
+ "3": 0.0,
712
+ "4": 0.0,
713
+ "5": 0.0,
714
+ "6": 0.0
715
+ },
716
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_5')": {
717
+ "4": 0.0028905,
718
+ "0": 0.0,
719
+ "1": 0.0,
720
+ "2": 0.0,
721
+ "3": 0.0,
722
+ "5": 0.0,
723
+ "6": 0.0
724
+ },
725
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_5')": {
726
+ "6": 0.004375533088189032,
727
+ "0": 0.0,
728
+ "1": 0.0,
729
+ "2": 0.0,
730
+ "3": 0.0,
731
+ "4": 0.0,
732
+ "5": 0.0
733
+ },
734
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_4')": {
735
+ "1": 0.0037815225000000004,
736
+ "0": 0.0,
737
+ "2": 0.0,
738
+ "3": 0.0,
739
+ "4": 0.0,
740
+ "5": 0.0,
741
+ "6": 0.0
742
+ },
743
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_5')": {
744
+ "3": 0.001095
745
+ },
746
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_6_3')": {
747
+ "3": 0.001
748
+ },
749
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_7_3')": {
750
+ "2": 0.012355355281635293,
751
+ "0": 0.0,
752
+ "1": 0.0,
753
+ "3": 0.0,
754
+ "4": 0.0,
755
+ "5": 0.0,
756
+ "6": 0.0
757
+ },
758
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_7_3')": {
759
+ "6": 0.0027955000000000002,
760
+ "0": 0.001189525,
761
+ "1": 0.0,
762
+ "2": 0.0,
763
+ "3": 0.0,
764
+ "4": 0.0,
765
+ "5": 0.0
766
+ },
767
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_3')": {
768
+ "6": 0.0020786543875,
769
+ "0": 0.0,
770
+ "1": 0.0,
771
+ "2": 0.0,
772
+ "3": 0.0,
773
+ "4": 0.0,
774
+ "5": 0.0
775
+ },
776
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_4')": {
777
+ "6": 0.0029850250000000005,
778
+ "0": 0.0,
779
+ "1": 0.0,
780
+ "2": 0.0,
781
+ "3": 0.0,
782
+ "4": 0.001,
783
+ "5": 0.0
784
+ },
785
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_5')": {
786
+ "0": 0.0027955000000000002,
787
+ "1": 0.0,
788
+ "2": 0.0,
789
+ "3": 0.0,
790
+ "4": 0.0,
791
+ "5": 0.0,
792
+ "6": 0.0
793
+ },
794
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_2_5')": {
795
+ "4": 0.0019000000000000002,
796
+ "0": 0.0,
797
+ "1": 0.0,
798
+ "2": 0.0,
799
+ "3": 0.0,
800
+ "5": 0.0,
801
+ "6": 0.0
802
+ },
803
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_1_5')": {
804
+ "1": 0.001,
805
+ "3": 0.001
806
+ },
807
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_1_4')": {
808
+ "3": 0.005455224438062501,
809
+ "0": 0.0,
810
+ "1": 0.0,
811
+ "2": 0.0,
812
+ "4": 0.0,
813
+ "5": 0.0,
814
+ "6": 0.0
815
+ },
816
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_1_3')": {
817
+ "2": 0.001,
818
+ "1": 0.0037711696375000003,
819
+ "0": 0.0,
820
+ "3": 0.0,
821
+ "4": 0.0,
822
+ "5": 0.0,
823
+ "6": 0.0
824
+ },
825
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_2_3')": {
826
+ "1": 0.008267726940779227,
827
+ "0": 0.0,
828
+ "2": 0.0,
829
+ "3": 0.0,
830
+ "4": 0.0,
831
+ "5": 0.001,
832
+ "6": 0.0
833
+ },
834
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_3_3')": {
835
+ "4": 0.0029850250000000005,
836
+ "0": 0.0,
837
+ "1": 0.0,
838
+ "2": 0.0,
839
+ "3": 0.0,
840
+ "5": 0.001,
841
+ "6": 0.0
842
+ },
843
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_4_3')": {
844
+ "5": 0.001
845
+ },
846
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_4_3')": {
847
+ "1": 0.0037815225000000004,
848
+ "0": 0.0,
849
+ "2": 0.0,
850
+ "3": 0.0,
851
+ "4": 0.0,
852
+ "5": 0.0,
853
+ "6": 0.0
854
+ },
855
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_4_4')": {
856
+ "6": 0.001
857
+ },
858
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_4')": {
859
+ "2": 0.001,
860
+ "6": 0.0019855000000000003
861
+ },
862
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_4')": {},
863
+ "('enemy_close', 'enemy_close', 'enemy_close', 'hp_3', 'pos_4_2')": {
864
+ "1": 0.0019000000000000002,
865
+ "0": 0.0,
866
+ "2": 0.0,
867
+ "3": 0.0,
868
+ "4": 0.0,
869
+ "5": 0.0,
870
+ "6": 0.0
871
+ },
872
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_4_2')": {
873
+ "2": 0.001
874
+ },
875
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_4_3')": {
876
+ "5": 0.00431787025,
877
+ "0": 0.0,
878
+ "1": 0.0,
879
+ "2": 0.0,
880
+ "3": 0.0,
881
+ "4": 0.0,
882
+ "6": 0.0
883
+ },
884
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_5_3')": {
885
+ "2": 0.0027955000000000002,
886
+ "0": 0.0,
887
+ "1": 0.0,
888
+ "3": 0.0,
889
+ "4": 0.0,
890
+ "5": 0.0,
891
+ "6": 0.0
892
+ },
893
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_5_4')": {
894
+ "0": 0.001,
895
+ "5": 0.0028805725000000003,
896
+ "1": 0.0,
897
+ "2": 0.0,
898
+ "3": 0.0,
899
+ "4": 0.0,
900
+ "6": 0.0
901
+ },
902
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_4_5')": {
903
+ "5": 0.001
904
+ },
905
+ "('enemy_close', 'enemy_mid', 'hp_3', 'pos_4_5')": {
906
+ "0": 0.004573089887500001,
907
+ "1": 0.0,
908
+ "2": 0.0,
909
+ "3": 0.0,
910
+ "4": 0.0,
911
+ "5": 0.0,
912
+ "6": 0.0
913
+ },
914
+ "('enemy_close', 'enemy_mid', 'hp_3', 'pos_3_5')": {
915
+ "3": 0.001
916
+ },
917
+ "('enemy_close', 'enemy_mid', 'hp_3', 'pos_3_4')": {
918
+ "6": 0.004573089887500001,
919
+ "0": 0.0,
920
+ "1": 0.0,
921
+ "2": 0.0,
922
+ "3": 0.0,
923
+ "4": 0.0,
924
+ "5": 0.0
925
+ },
926
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_3_4')": {
927
+ "0": 0.002805,
928
+ "1": 0.0,
929
+ "2": 0.0,
930
+ "3": 0.0,
931
+ "4": 0.0,
932
+ "5": 0.0,
933
+ "6": 0.0
934
+ },
935
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_2_4')": {
936
+ "3": 0.002183577375,
937
+ "0": 0.0,
938
+ "1": 0.0,
939
+ "2": 0.0,
940
+ "4": 0.0,
941
+ "5": 0.0,
942
+ "6": 0.0
943
+ },
944
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_2_3')": {
945
+ "6": 0.0019000000000000002,
946
+ "0": 0.0,
947
+ "1": 0.0,
948
+ "2": 0.0,
949
+ "3": 0.0,
950
+ "4": 0.0,
951
+ "5": 0.0
952
+ },
953
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_3_3')": {
954
+ "6": 0.0027955000000000002,
955
+ "0": 0.0,
956
+ "1": 0.0,
957
+ "2": 0.0,
958
+ "3": 0.0,
959
+ "4": 0.0,
960
+ "5": 0.0
961
+ },
962
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_3')": {
963
+ "3": 0.001095
964
+ },
965
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_5_2')": {
966
+ "3": 0.0019000000000000002,
967
+ "0": 0.0,
968
+ "1": 0.0,
969
+ "2": 0.0,
970
+ "4": 0.0,
971
+ "5": 0.0,
972
+ "6": 0.0
973
+ },
974
+ "('enemy_far', 'enemy_mid', 'hp_3', 'pos_6_2')": {
975
+ "4": 0.001
976
+ },
977
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_6_2')": {
978
+ "2": 0.0029850250000000005,
979
+ "0": 0.0,
980
+ "1": 0.001,
981
+ "3": 0.001189525,
982
+ "4": 0.0,
983
+ "5": 0.0,
984
+ "6": 0.0
985
+ },
986
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_6_1')": {},
987
+ "('enemy_close', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_2')": {
988
+ "2": 0.005455224438062501,
989
+ "0": 0.0,
990
+ "1": 0.0,
991
+ "3": 0.0012835773750000002,
992
+ "4": 0.0,
993
+ "5": 0.0,
994
+ "6": 0.0
995
+ },
996
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_2')": {
997
+ "3": 0.0019000000000000002,
998
+ "0": 0.0,
999
+ "1": 0.0,
1000
+ "2": 0.0,
1001
+ "4": 0.0,
1002
+ "5": 0.0,
1003
+ "6": 0.0
1004
+ },
1005
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_1')": {
1006
+ "5": 0.0036865225000000004,
1007
+ "0": 0.0,
1008
+ "1": 0.0,
1009
+ "2": 0.0,
1010
+ "3": 0.0,
1011
+ "4": 0.0,
1012
+ "6": 0.0
1013
+ },
1014
+ "('enemy_close', 'hp_3', 'pos_2_1')": {
1015
+ "2": 0.0027955000000000002,
1016
+ "0": 0.0,
1017
+ "1": 0.0,
1018
+ "3": 0.0,
1019
+ "4": 0.0,
1020
+ "5": 0.0,
1021
+ "6": 0.0
1022
+ },
1023
+ "('enemy_mid', 'hp_3', 'pos_2_1')": {
1024
+ "4": 0.007583443062417828,
1025
+ "0": 0.001189525,
1026
+ "1": 0.0,
1027
+ "2": 0.0,
1028
+ "3": 0.0,
1029
+ "5": 0.0,
1030
+ "6": 0.0
1031
+ },
1032
+ "('enemy_mid', 'hp_3', 'pos_1_2')": {
1033
+ "3": 0.001
1034
+ },
1035
+ "('enemy_far', 'hp_3', 'pos_1_2')": {
1036
+ "3": 0.005909701994256251,
1037
+ "0": 0.0,
1038
+ "1": 0.0,
1039
+ "2": 0.0,
1040
+ "4": 0.0,
1041
+ "5": 0.0,
1042
+ "6": 0.0
1043
+ },
1044
+ "('enemy_far', 'hp_3', 'pos_1_1')": {
1045
+ "5": 0.011675438617124839,
1046
+ "0": 0.0012835773750000002,
1047
+ "1": 0.0,
1048
+ "2": 0.0,
1049
+ "3": 0.0021091666686268596,
1050
+ "4": 0.0,
1051
+ "6": 0.0021091666686268596
1052
+ },
1053
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_4')": {
1054
+ "4": 0.00215745,
1055
+ "0": 0.0,
1056
+ "1": 0.0,
1057
+ "2": 0.0,
1058
+ "3": 0.0,
1059
+ "5": 0.0,
1060
+ "6": 0.0
1061
+ },
1062
+ "('enemy_close', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_4')": {
1063
+ "0": 0.0027955000000000002,
1064
+ "2": 0.001,
1065
+ "1": 0.0,
1066
+ "3": 0.0,
1067
+ "4": 0.0,
1068
+ "5": 0.0,
1069
+ "6": 0.0
1070
+ },
1071
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_4')": {
1072
+ "1": 0.001
1073
+ },
1074
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_4')": {
1075
+ "1": 0.0024182463216159376,
1076
+ "0": 0.0,
1077
+ "2": 0.0,
1078
+ "3": 0.0,
1079
+ "4": 0.0,
1080
+ "5": 0.0,
1081
+ "6": 0.0
1082
+ },
1083
+ "('enemy_far', 'hp_3', 'pos_6_5')": {
1084
+ "2": 0.00980017651616106,
1085
+ "0": 0.0,
1086
+ "1": 0.0,
1087
+ "3": 0.0,
1088
+ "4": 0.0,
1089
+ "5": 0.0014702736906843752,
1090
+ "6": 0.0
1091
+ },
1092
+ "('enemy_mid', 'hp_3', 'pos_6_5')": {
1093
+ "5": 0.001,
1094
+ "1": 0.001
1095
+ },
1096
+ "('enemy_mid', 'hp_3', 'pos_7_5')": {
1097
+ "4": 0.001,
1098
+ "0": 0.001095,
1099
+ "3": 0.001
1100
+ },
1101
+ "('enemy_close', 'hp_3', 'pos_7_4')": {
1102
+ "0": 0.0019000000000000002,
1103
+ "1": 0.0,
1104
+ "2": 0.0,
1105
+ "3": 0.0,
1106
+ "4": 0.0,
1107
+ "5": 0.0,
1108
+ "6": 0.0
1109
+ },
1110
+ "('enemy_close', 'hp_3', 'pos_6_4')": {
1111
+ "1": 0.0019000000000000002,
1112
+ "0": 0.0,
1113
+ "2": 0.0,
1114
+ "3": 0.0,
1115
+ "4": 0.0,
1116
+ "5": 0.0,
1117
+ "6": 0.0
1118
+ },
1119
+ "('enemy_mid', 'hp_3', 'pos_6_4')": {
1120
+ "6": 0.001,
1121
+ "3": 0.001
1122
+ },
1123
+ "('enemy_mid', 'hp_3', 'pos_6_3')": {
1124
+ "3": 0.005455224438062501,
1125
+ "0": 0.0,
1126
+ "1": 0.0,
1127
+ "2": 0.0,
1128
+ "4": 0.0,
1129
+ "5": 0.0,
1130
+ "6": 0.0
1131
+ },
1132
+ "('enemy_far', 'hp_3', 'pos_6_3')": {
1133
+ "6": 0.001
1134
+ },
1135
+ "('enemy_far', 'hp_3', 'pos_6_2')": {
1136
+ "1": 0.0019000000000000002,
1137
+ "0": 0.0,
1138
+ "2": 0.0,
1139
+ "3": 0.0,
1140
+ "4": 0.0,
1141
+ "5": 0.0,
1142
+ "6": 0.0
1143
+ },
1144
+ "('enemy_mid', 'hp_3', 'pos_6_2')": {
1145
+ "6": 0.001
1146
+ },
1147
+ "('enemy_mid', 'hp_3', 'pos_7_2')": {
1148
+ "4": 0.0019950000000000002,
1149
+ "0": 0.0,
1150
+ "1": 0.0,
1151
+ "2": 0.0,
1152
+ "3": 0.0,
1153
+ "5": 0.0,
1154
+ "6": 0.0
1155
+ },
1156
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_3_2')": {
1157
+ "1": 0.0038582248696280644,
1158
+ "0": 0.0,
1159
+ "2": 0.0,
1160
+ "3": 0.0,
1161
+ "4": 0.0,
1162
+ "5": 0.0,
1163
+ "6": 0.0
1164
+ },
1165
+ "('enemy_close', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_3')": {
1166
+ "0": 0.001
1167
+ },
1168
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_2_3')": {
1169
+ "3": 0.003505983665265065,
1170
+ "0": 0.0,
1171
+ "1": 0.0,
1172
+ "2": 0.0,
1173
+ "4": 0.0,
1174
+ "5": 0.0,
1175
+ "6": 0.001
1176
+ },
1177
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_1_2')": {
1178
+ "0": 0.001,
1179
+ "1": 0.0028805725000000003,
1180
+ "2": 0.0,
1181
+ "3": 0.0,
1182
+ "4": 0.0,
1183
+ "5": 0.0,
1184
+ "6": 0.0
1185
+ },
1186
+ "('enemy_close', 'enemy_far', 'enemy_far', 'hp_3', 'pos_1_2')": {
1187
+ "4": 0.0019950000000000002,
1188
+ "0": 0.0,
1189
+ "1": 0.0,
1190
+ "2": 0.001,
1191
+ "3": 0.0,
1192
+ "5": 0.0,
1193
+ "6": 0.0
1194
+ },
1195
+ "('enemy_close', 'enemy_far', 'enemy_far', 'hp_3', 'pos_2_2')": {
1196
+ "2": 0.001,
1197
+ "4": 0.001095,
1198
+ "5": 0.004185585850131244,
1199
+ "0": 0.0,
1200
+ "1": 0.0,
1201
+ "3": 0.0,
1202
+ "6": 0.0
1203
+ },
1204
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_2')": {
1205
+ "3": 0.0036865225000000004,
1206
+ "0": 0.0,
1207
+ "1": 0.0,
1208
+ "2": 0.0,
1209
+ "4": 0.0,
1210
+ "5": 0.0,
1211
+ "6": 0.0
1212
+ },
1213
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_1')": {
1214
+ "0": 0.0029850250000000005,
1215
+ "1": 0.001,
1216
+ "2": 0.0,
1217
+ "3": 0.0,
1218
+ "4": 0.0,
1219
+ "5": 0.0,
1220
+ "6": 0.0
1221
+ },
1222
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_1_1')": {
1223
+ "6": 0.004573089887500001,
1224
+ "0": 0.0,
1225
+ "1": 0.0,
1226
+ "2": 0.0,
1227
+ "3": 0.0,
1228
+ "4": 0.0,
1229
+ "5": 0.0
1230
+ },
1231
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_1_1')": {
1232
+ "3": 0.001,
1233
+ "4": 0.009022015150864955,
1234
+ "0": 0.0,
1235
+ "1": 0.0,
1236
+ "2": 0.0,
1237
+ "5": 0.0,
1238
+ "6": 0.0
1239
+ },
1240
+ "('hp_3', 'pos_1_1')": {
1241
+ "1": 1.0010000000000001
1242
+ },
1243
+ "('enemy_close', 'enemy_close', 'enemy_far', 'hp_3', 'pos_2_3')": {
1244
+ "2": 0.001,
1245
+ "6": 0.001
1246
+ },
1247
+ "('enemy_close', 'enemy_close', 'enemy_far', 'hp_3', 'pos_2_2')": {
1248
+ "6": 0.005550224438062501,
1249
+ "0": 0.0,
1250
+ "1": 0.0,
1251
+ "2": 0.0,
1252
+ "3": 0.0,
1253
+ "4": 0.0,
1254
+ "5": 0.0
1255
+ },
1256
+ "('enemy_close', 'enemy_close', 'enemy_far', 'hp_3', 'pos_3_3')": {
1257
+ "1": 0.001
1258
+ },
1259
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_3_3')": {
1260
+ "0": 0.0015947735769543437
1261
+ },
1262
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_4')": {
1263
+ "3": 0.0019950000000000002,
1264
+ "0": 0.0,
1265
+ "1": 0.0,
1266
+ "2": 0.0,
1267
+ "4": 0.0,
1268
+ "5": 0.0,
1269
+ "6": 0.0
1270
+ },
1271
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_4_3')": {
1272
+ "0": 0.0022267050000000003,
1273
+ "1": 0.0,
1274
+ "2": 0.0,
1275
+ "3": 0.0,
1276
+ "4": 0.0,
1277
+ "5": 0.0,
1278
+ "6": 0.0
1279
+ },
1280
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_4_3')": {
1281
+ "3": 0.001,
1282
+ "2": 0.0024199435393125,
1283
+ "0": 0.0,
1284
+ "1": 0.0,
1285
+ "4": 0.0,
1286
+ "5": 0.0,
1287
+ "6": 0.0
1288
+ },
1289
+ "('enemy_mid', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_3_2')": {
1290
+ "4": 0.0029845686655553426,
1291
+ "0": 0.0,
1292
+ "1": 0.0,
1293
+ "2": 0.0,
1294
+ "3": 0.0,
1295
+ "5": 0.0,
1296
+ "6": 0.0
1297
+ },
1298
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_3_2')": {
1299
+ "3": 0.001,
1300
+ "1": 0.001095,
1301
+ "4": 0.001104025,
1302
+ "2": 0.0017468321720666997
1303
+ },
1304
+ "('enemy_far', 'enemy_far', 'enemy_far', 'hp_3', 'pos_4_3')": {
1305
+ "5": 0.0015129711176250001
1306
+ },
1307
+ "('enemy_close', 'enemy_close', 'enemy_close', 'hp_3', 'pos_3_3')": {
1308
+ "3": 0.001
1309
+ },
1310
+ "('enemy_close', 'enemy_close', 'enemy_close', 'hp_3', 'pos_3_2')": {
1311
+ "5": 0.0012834916375000002
1312
+ },
1313
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_5_1')": {
1314
+ "4": 0.0017923783423600297
1315
+ },
1316
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_5_1')": {
1317
+ "1": 0.001,
1318
+ "4": 0.006416332084264109,
1319
+ "0": 0.0,
1320
+ "2": 0.0,
1321
+ "3": 0.0,
1322
+ "5": 0.0,
1323
+ "6": 0.0
1324
+ },
1325
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_6_1')": {
1326
+ "3": 0.001095
1327
+ },
1328
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_3_3')": {
1329
+ "6": 0.0040367421375,
1330
+ "0": 0.0,
1331
+ "1": 0.0,
1332
+ "2": 0.0,
1333
+ "3": 0.0,
1334
+ "4": 0.0012835773750000002,
1335
+ "5": 0.0
1336
+ },
1337
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_4_4')": {
1338
+ "5": 0.001095
1339
+ },
1340
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_4_4')": {
1341
+ "6": 0.001
1342
+ },
1343
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_3', 'pos_3_4')": {
1344
+ "2": 0.0019000000000000002,
1345
+ "0": 0.0,
1346
+ "1": 0.0,
1347
+ "3": 0.0,
1348
+ "4": 0.0,
1349
+ "5": 0.0,
1350
+ "6": 0.0
1351
+ },
1352
+ "('enemy_close', 'enemy_far', 'enemy_far', 'hp_3', 'pos_3_5')": {
1353
+ "5": 0.0036865225000000004,
1354
+ "0": 0.0,
1355
+ "1": 0.0,
1356
+ "2": 0.0,
1357
+ "3": 0.0,
1358
+ "4": 0.0,
1359
+ "6": 0.0
1360
+ },
1361
+ "('enemy_close', 'enemy_far', 'hp_3', 'pos_3_5')": {
1362
+ "3": 0.0011805000000000001
1363
+ },
1364
+ "('enemy_close', 'enemy_mid', 'hp_3', 'pos_3_3')": {
1365
+ "0": 0.0027955000000000002,
1366
+ "1": 0.0,
1367
+ "2": 0.0,
1368
+ "3": 0.0,
1369
+ "4": 0.0,
1370
+ "5": 0.0,
1371
+ "6": 0.0
1372
+ },
1373
+ "('enemy_close', 'enemy_mid', 'hp_3', 'pos_2_3')": {
1374
+ "5": 0.001
1375
+ },
1376
+ "('enemy_mid', 'enemy_mid', 'hp_3', 'pos_2_3')": {
1377
+ "2": 0.00266714895486003,
1378
+ "0": 0.0,
1379
+ "1": 0.0,
1380
+ "3": 0.0,
1381
+ "4": 0.0,
1382
+ "5": 0.0,
1383
+ "6": 0.0
1384
+ },
1385
+ "('enemy_far', 'enemy_far', 'hp_3', 'pos_2_3')": {
1386
+ "4": 0.001
1387
+ },
1388
+ "('enemy_far', 'hp_3', 'pos_2_3')": {
1389
+ "0": 0.0027955000000000002,
1390
+ "1": 0.0,
1391
+ "2": 0.0,
1392
+ "3": 0.0,
1393
+ "4": 0.0,
1394
+ "5": 0.0,
1395
+ "6": 0.0
1396
+ },
1397
+ "('enemy_far', 'hp_3', 'pos_1_3')": {
1398
+ "3": 0.003313746321615938,
1399
+ "0": 0.0,
1400
+ "1": 0.0,
1401
+ "2": 0.0,
1402
+ "4": 0.0,
1403
+ "5": 0.0,
1404
+ "6": 0.0
1405
+ },
1406
+ "('enemy_far', 'hp_3', 'pos_0_2')": {
1407
+ "5": 0.005455224438062501,
1408
+ "0": 0.0,
1409
+ "1": 0.0,
1410
+ "2": 0.0,
1411
+ "3": 0.001189525,
1412
+ "4": 0.0,
1413
+ "6": 0.0
1414
+ },
1415
+ "('enemy_far', 'hp_3', 'pos_0_1')": {
1416
+ "3": 0.005925498128746876,
1417
+ "0": 0.0,
1418
+ "1": 0.0,
1419
+ "2": 0.0,
1420
+ "4": 0.0,
1421
+ "5": 0.0,
1422
+ "6": 0.0
1423
+ },
1424
+ "('enemy_close', 'enemy_close', 'enemy_mid', 'hp_3', 'pos_5_2')": {
1425
+ "1": 0.0036865225000000004,
1426
+ "0": 0.0,
1427
+ "2": 0.0,
1428
+ "3": 0.0,
1429
+ "4": 0.0,
1430
+ "5": 0.0,
1431
+ "6": 0.0
1432
+ },
1433
+ "('enemy_close', 'enemy_close', 'enemy_far', 'hp_3', 'pos_6_2')": {
1434
+ "6": 0.002238691096757993,
1435
+ "0": 0.0,
1436
+ "1": 0.0,
1437
+ "2": 0.0,
1438
+ "3": 0.0,
1439
+ "4": 0.0,
1440
+ "5": 0.0
1441
+ },
1442
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_7_2')": {
1443
+ "4": 0.0019000000000000002,
1444
+ "0": 0.0,
1445
+ "1": 0.0,
1446
+ "2": 0.0,
1447
+ "3": 0.0,
1448
+ "5": 0.0,
1449
+ "6": 0.0
1450
+ },
1451
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_3', 'pos_7_3')": {
1452
+ "4": 0.001
1453
+ },
1454
+ "('enemy_far', 'enemy_far', 'enemy_mid', 'hp_2', 'pos_6_3')": {
1455
+ "4": 0.001
1456
+ },
1457
+ "('enemy_far', 'enemy_mid', 'enemy_mid', 'hp_2', 'pos_6_4')": {
1458
+ "6": 0.0019000000000000002,
1459
+ "0": 0.0,
1460
+ "1": 0.0,
1461
+ "2": 0.0,
1462
+ "3": 0.0,
1463
+ "4": 0.0,
1464
+ "5": 0.0
1465
+ },
1466
+ "('enemy_close', 'enemy_far', 'enemy_mid', 'hp_2', 'pos_6_4')": {
1467
+ "5": 0.0019000000000000002,
1468
+ "0": 0.0,
1469
+ "1": 0.0,
1470
+ "2": 0.0,
1471
+ "3": 0.0,
1472
+ "4": 0.0,
1473
+ "6": 0.0
1474
+ },
1475
+ "('enemy_mid', 'enemy_mid', 'hp_2', 'pos_6_4')": {
1476
+ "0": 0.001,
1477
+ "2": 0.008377534060647993,
1478
+ "1": 0.0,
1479
+ "3": 0.0,
1480
+ "4": 0.0,
1481
+ "5": 0.0016453816993769654,
1482
+ "6": 0.0
1483
+ },
1484
+ "('enemy_close', 'enemy_mid', 'hp_2', 'pos_6_5')": {
1485
+ "2": 0.010786915292227773,
1486
+ "0": 0.0,
1487
+ "1": 0.0,
1488
+ "3": 0.0,
1489
+ "4": 0.0,
1490
+ "5": 0.0,
1491
+ "6": 0.0
1492
+ },
1493
+ "('enemy_close', 'enemy_mid', 'hp_2', 'pos_5_5')": {
1494
+ "1": 0.0022502196375,
1495
+ "0": 0.0,
1496
+ "2": 0.0,
1497
+ "3": 0.0,
1498
+ "4": 0.0,
1499
+ "5": 0.0,
1500
+ "6": 0.0
1501
+ },
1502
+ "('enemy_mid', 'enemy_mid', 'hp_2', 'pos_6_5')": {
1503
+ "6": 0.005392987913055791,
1504
+ "0": 0.0,
1505
+ "1": 0.0,
1506
+ "2": 0.0,
1507
+ "3": 0.0,
1508
+ "4": 0.0,
1509
+ "5": 0.0
1510
+ }
1511
+ },
1512
+ "metadata": {
1513
+ "version": "1.0.0",
1514
+ "framework": "custom",
1515
+ "description": "Q-Learning agent trained on TeeUnit environment",
1516
+ "space_url": "https://huggingface.co/spaces/ziadbc/teeunit-env",
1517
+ "github_url": "https://github.com/ziadgit/teeunit"
1518
+ }
1519
+ }
teeunit_qlearning_agent.pkl ADDED
Binary file (24 kB). View file