Hugging Face's logo

diepala
/
ppo-SnowballTarget

Reinforcement Learning
ml-agents
TensorBoard
ONNX
SnowballTarget
deep-reinforcement-learning
ML-Agents-SnowballTarget
Model card Files
xet
Metrics Community
diepala commited on
Commit
2b9f5d4
·
verified ·
1 Parent(s): f7caf50

First Push

Browse files
Files changed (4) hide show
  1. SnowballTarget/events.out.tfevents.1718997979.11cf20b04337.5707.0 +3 -0
  2. run_logs/Player-0.log +17 -17
  3. run_logs/timers.json +22 -321
  4. run_logs/training_status.json +11 -2
SnowballTarget/events.out.tfevents.1718997979.11cf20b04337.5707.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:808774b9e371608cce2bc268054160f27abb8228269288a27d7faf73504d5361
3
+ size 1114
run_logs/Player-0.log CHANGED
@@ -31,7 +31,7 @@ ALSA lib pcm.c:2664:(snd_pcm_open_noupdate) Unknown PCM default
31
  FMOD failed to initialize the output device.: "Error initializing output device. " (60)
32
  FMOD initialized on nosound output
33
  Begin MonoManager ReloadAssembly
34
- - Completed reload, in 0.083 seconds
35
  ERROR: Shader Sprites/Default shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
36
  ERROR: Shader Sprites/Mask shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
37
  ERROR: Shader Legacy Shaders/VertexLit shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
@@ -42,7 +42,7 @@ ERROR: Shader Standard shader is not supported on this GPU (none of subshaders/f
42
  WARNING: Shader Unsupported: 'Standard' - All subshaders removed
43
  WARNING: Shader Did you use #pragma only_renderers and omit this platform?
44
  WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
45
- UnloadTime: 0.655288 ms
46
  ERROR: Shader UI/Default shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
47
  requesting resize 84 x 84
48
  Setting up 1 worker threads for Enlighten.
@@ -50,7 +50,7 @@ Memory Statistics:
50
  [ALLOC_TEMP_TLS] TLS Allocator
51
  StackAllocators :
52
  [ALLOC_TEMP_MAIN]
53
- Peak usage frame count: [8.0 KB-16.0 KB]: 2146 frames, [16.0 KB-32.0 KB]: 36 frames, [2.0 MB-4.0 MB]: 1 frames
54
  Initial Block Size 4.0 MB
55
  Current Block Size 4.0 MB
56
  Peak Allocated Bytes 2.0 MB
@@ -78,7 +78,7 @@ Memory Statistics:
78
  [ALLOC_TEMP_Job.Worker 0]
79
  Initial Block Size 256.0 KB
80
  Current Block Size 256.0 KB
81
- Peak Allocated Bytes 3.6 KB
82
  Overflow Count 0
83
  [ALLOC_TEMP_Background Job.Worker 10]
84
  Initial Block Size 32.0 KB
@@ -166,19 +166,19 @@ Memory Statistics:
166
  Peak Allocated Bytes 0 B
167
  Overflow Count 0
168
  [ALLOC_DEFAULT] Dual Thread Allocator
169
- Peak main deferred allocation count 40
170
  [ALLOC_BUCKET]
171
  Large Block size 4.0 MB
172
  Used Block count 1
173
  Peak Allocated bytes 1.0 MB
174
  [ALLOC_DEFAULT_MAIN]
175
- Peak usage frame count: [4.0 MB-8.0 MB]: 2183 frames
176
  Requested Block Size 16.0 MB
177
  Peak Block count 1
178
- Peak Allocated memory 5.8 MB
179
  Peak Large allocation bytes 0 B
180
  [ALLOC_DEFAULT_THREAD]
181
- Peak usage frame count: [16.0 MB-32.0 MB]: 2183 frames
182
  Requested Block Size 16.0 MB
183
  Peak Block count 1
184
  Peak Allocated memory 17.7 MB
@@ -195,7 +195,7 @@ Memory Statistics:
195
  Overflow Count (full) 0
196
  [ALLOC_TEMP_JOB_4_FRAMES (JobTemp)]
197
  Initial Block Size 2.0 MB
198
- Used Block Count 2
199
  Overflow Count (too large) 0
200
  Overflow Count (full) 0
201
  [ALLOC_TEMP_JOB_ASYNC (Background)]
@@ -210,13 +210,13 @@ Memory Statistics:
210
  Used Block count 1
211
  Peak Allocated bytes 1.0 MB
212
  [ALLOC_GFX_MAIN]
213
- Peak usage frame count: [32.0 KB-64.0 KB]: 1522 frames, [64.0 KB-128.0 KB]: 661 frames
214
  Requested Block Size 16.0 MB
215
  Peak Block count 1
216
- Peak Allocated memory 67.3 KB
217
  Peak Large allocation bytes 0 B
218
  [ALLOC_GFX_THREAD]
219
- Peak usage frame count: [32.0 KB-64.0 KB]: 2183 frames
220
  Requested Block Size 16.0 MB
221
  Peak Block count 1
222
  Peak Allocated memory 39.6 KB
@@ -228,13 +228,13 @@ Memory Statistics:
228
  Used Block count 1
229
  Peak Allocated bytes 1.0 MB
230
  [ALLOC_CACHEOBJECTS_MAIN]
231
- Peak usage frame count: [0.5 MB-1.0 MB]: 2183 frames
232
  Requested Block Size 4.0 MB
233
  Peak Block count 1
234
- Peak Allocated memory 0.6 MB
235
  Peak Large allocation bytes 0 B
236
  [ALLOC_CACHEOBJECTS_THREAD]
237
- Peak usage frame count: [0.5 MB-1.0 MB]: 2182 frames, [2.0 MB-4.0 MB]: 1 frames
238
  Requested Block Size 4.0 MB
239
  Peak Block count 1
240
  Peak Allocated memory 2.2 MB
@@ -246,13 +246,13 @@ Memory Statistics:
246
  Used Block count 1
247
  Peak Allocated bytes 1.0 MB
248
  [ALLOC_TYPETREE_MAIN]
249
- Peak usage frame count: [0-1.0 KB]: 2183 frames
250
  Requested Block Size 2.0 MB
251
  Peak Block count 1
252
  Peak Allocated memory 1.0 KB
253
  Peak Large allocation bytes 0 B
254
  [ALLOC_TYPETREE_THREAD]
255
- Peak usage frame count: [1.0 KB-2.0 KB]: 2183 frames
256
  Requested Block Size 2.0 MB
257
  Peak Block count 1
258
  Peak Allocated memory 1.7 KB
 
31
  FMOD failed to initialize the output device.: "Error initializing output device. " (60)
32
  FMOD initialized on nosound output
33
  Begin MonoManager ReloadAssembly
34
+ - Completed reload, in 0.133 seconds
35
  ERROR: Shader Sprites/Default shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
36
  ERROR: Shader Sprites/Mask shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
37
  ERROR: Shader Legacy Shaders/VertexLit shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
 
42
  WARNING: Shader Unsupported: 'Standard' - All subshaders removed
43
  WARNING: Shader Did you use #pragma only_renderers and omit this platform?
44
  WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
45
+ UnloadTime: 0.914041 ms
46
  ERROR: Shader UI/Default shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
47
  requesting resize 84 x 84
48
  Setting up 1 worker threads for Enlighten.
 
50
  [ALLOC_TEMP_TLS] TLS Allocator
51
  StackAllocators :
52
  [ALLOC_TEMP_MAIN]
53
+ Peak usage frame count: [2.0 MB-4.0 MB]: 1 frames
54
  Initial Block Size 4.0 MB
55
  Current Block Size 4.0 MB
56
  Peak Allocated Bytes 2.0 MB
 
78
  [ALLOC_TEMP_Job.Worker 0]
79
  Initial Block Size 256.0 KB
80
  Current Block Size 256.0 KB
81
+ Peak Allocated Bytes 2.8 KB
82
  Overflow Count 0
83
  [ALLOC_TEMP_Background Job.Worker 10]
84
  Initial Block Size 32.0 KB
 
166
  Peak Allocated Bytes 0 B
167
  Overflow Count 0
168
  [ALLOC_DEFAULT] Dual Thread Allocator
169
+ Peak main deferred allocation count 3
170
  [ALLOC_BUCKET]
171
  Large Block size 4.0 MB
172
  Used Block count 1
173
  Peak Allocated bytes 1.0 MB
174
  [ALLOC_DEFAULT_MAIN]
175
+ Peak usage frame count: [4.0 MB-8.0 MB]: 1 frames
176
  Requested Block Size 16.0 MB
177
  Peak Block count 1
178
+ Peak Allocated memory 4.6 MB
179
  Peak Large allocation bytes 0 B
180
  [ALLOC_DEFAULT_THREAD]
181
+ Peak usage frame count: [16.0 MB-32.0 MB]: 1 frames
182
  Requested Block Size 16.0 MB
183
  Peak Block count 1
184
  Peak Allocated memory 17.7 MB
 
195
  Overflow Count (full) 0
196
  [ALLOC_TEMP_JOB_4_FRAMES (JobTemp)]
197
  Initial Block Size 2.0 MB
198
+ Used Block Count 1
199
  Overflow Count (too large) 0
200
  Overflow Count (full) 0
201
  [ALLOC_TEMP_JOB_ASYNC (Background)]
 
210
  Used Block count 1
211
  Peak Allocated bytes 1.0 MB
212
  [ALLOC_GFX_MAIN]
213
+ Peak usage frame count: [64.0 KB-128.0 KB]: 1 frames
214
  Requested Block Size 16.0 MB
215
  Peak Block count 1
216
+ Peak Allocated memory 65.6 KB
217
  Peak Large allocation bytes 0 B
218
  [ALLOC_GFX_THREAD]
219
+ Peak usage frame count: [32.0 KB-64.0 KB]: 1 frames
220
  Requested Block Size 16.0 MB
221
  Peak Block count 1
222
  Peak Allocated memory 39.6 KB
 
228
  Used Block count 1
229
  Peak Allocated bytes 1.0 MB
230
  [ALLOC_CACHEOBJECTS_MAIN]
231
+ Peak usage frame count: [0.5 MB-1.0 MB]: 1 frames
232
  Requested Block Size 4.0 MB
233
  Peak Block count 1
234
+ Peak Allocated memory 0.5 MB
235
  Peak Large allocation bytes 0 B
236
  [ALLOC_CACHEOBJECTS_THREAD]
237
+ Peak usage frame count: [2.0 MB-4.0 MB]: 1 frames
238
  Requested Block Size 4.0 MB
239
  Peak Block count 1
240
  Peak Allocated memory 2.2 MB
 
246
  Used Block count 1
247
  Peak Allocated bytes 1.0 MB
248
  [ALLOC_TYPETREE_MAIN]
249
+ Peak usage frame count: [0-1.0 KB]: 1 frames
250
  Requested Block Size 2.0 MB
251
  Peak Block count 1
252
  Peak Allocated memory 1.0 KB
253
  Peak Large allocation bytes 0 B
254
  [ALLOC_TYPETREE_THREAD]
255
+ Peak usage frame count: [1.0 KB-2.0 KB]: 1 frames
256
  Requested Block Size 2.0 MB
257
  Peak Block count 1
258
  Peak Allocated memory 1.7 KB
run_logs/timers.json CHANGED
@@ -1,154 +1,8 @@
1
  {
2
  "name": "root",
3
- "gauges": {
4
- "SnowballTarget.Policy.Entropy.mean": {
5
- "value": 1.8388103246688843,
6
- "min": 1.8388103246688843,
7
- "max": 2.697197437286377,
8
- "count": 8
9
- },
10
- "SnowballTarget.Policy.Entropy.sum": {
11
- "value": 17779.45703125,
12
- "min": 17779.45703125,
13
- "max": 27532.990234375,
14
- "count": 8
15
- },
16
- "SnowballTarget.Step.mean": {
17
- "value": 99960.0,
18
- "min": 29944.0,
19
- "max": 99960.0,
20
- "count": 8
21
- },
22
- "SnowballTarget.Step.sum": {
23
- "value": 99960.0,
24
- "min": 29944.0,
25
- "max": 99960.0,
26
- "count": 8
27
- },
28
- "SnowballTarget.Policy.ExtrinsicValueEstimate.mean": {
29
- "value": 7.986837863922119,
30
- "min": 2.042309045791626,
31
- "max": 7.986837863922119,
32
- "count": 8
33
- },
34
- "SnowballTarget.Policy.ExtrinsicValueEstimate.sum": {
35
- "value": 1629.31494140625,
36
- "min": 383.9541015625,
37
- "max": 1629.31494140625,
38
- "count": 8
39
- },
40
- "SnowballTarget.Environment.EpisodeLength.mean": {
41
- "value": 199.0,
42
- "min": 199.0,
43
- "max": 199.0,
44
- "count": 8
45
- },
46
- "SnowballTarget.Environment.EpisodeLength.sum": {
47
- "value": 10945.0,
48
- "min": 8756.0,
49
- "max": 10945.0,
50
- "count": 8
51
- },
52
- "SnowballTarget.Losses.PolicyLoss.mean": {
53
- "value": 0.06377117602147765,
54
- "min": 0.06377117602147765,
55
- "max": 0.07552168343667576,
56
- "count": 8
57
- },
58
- "SnowballTarget.Losses.PolicyLoss.sum": {
59
- "value": 0.31885588010738825,
60
- "min": 0.26500132058715153,
61
- "max": 0.33908892659511525,
62
- "count": 8
63
- },
64
- "SnowballTarget.Losses.ValueLoss.mean": {
65
- "value": 0.252603546836797,
66
- "min": 0.23992218752848168,
67
- "max": 0.27691544528101003,
68
- "count": 8
69
- },
70
- "SnowballTarget.Losses.ValueLoss.sum": {
71
- "value": 1.2630177341839848,
72
- "min": 0.9596887501139267,
73
- "max": 1.3845772264050502,
74
- "count": 8
75
- },
76
- "SnowballTarget.Policy.LearningRate.mean": {
77
- "value": 1.4736095088000004e-05,
78
- "min": 1.4736095088000004e-05,
79
- "max": 0.00022263602578799998,
80
- "count": 8
81
- },
82
- "SnowballTarget.Policy.LearningRate.sum": {
83
- "value": 7.368047544000002e-05,
84
- "min": 7.368047544000002e-05,
85
- "max": 0.0008905441031519999,
86
- "count": 8
87
- },
88
- "SnowballTarget.Policy.Epsilon.mean": {
89
- "value": 0.104912,
90
- "min": 0.104912,
91
- "max": 0.17421199999999998,
92
- "count": 8
93
- },
94
- "SnowballTarget.Policy.Epsilon.sum": {
95
- "value": 0.52456,
96
- "min": 0.459248,
97
- "max": 0.77756,
98
- "count": 8
99
- },
100
- "SnowballTarget.Policy.Beta.mean": {
101
- "value": 0.0002551088000000001,
102
- "min": 0.0002551088000000001,
103
- "max": 0.0037131787999999995,
104
- "count": 8
105
- },
106
- "SnowballTarget.Policy.Beta.sum": {
107
- "value": 0.0012755440000000004,
108
- "min": 0.0012755440000000004,
109
- "max": 0.014852715199999998,
110
- "count": 8
111
- },
112
- "SnowballTarget.Environment.CumulativeReward.mean": {
113
- "value": 17.727272727272727,
114
- "min": 6.818181818181818,
115
- "max": 17.727272727272727,
116
- "count": 8
117
- },
118
- "SnowballTarget.Environment.CumulativeReward.sum": {
119
- "value": 975.0,
120
- "min": 300.0,
121
- "max": 975.0,
122
- "count": 8
123
- },
124
- "SnowballTarget.Policy.ExtrinsicReward.mean": {
125
- "value": 17.727272727272727,
126
- "min": 6.818181818181818,
127
- "max": 17.727272727272727,
128
- "count": 8
129
- },
130
- "SnowballTarget.Policy.ExtrinsicReward.sum": {
131
- "value": 975.0,
132
- "min": 300.0,
133
- "max": 975.0,
134
- "count": 8
135
- },
136
- "SnowballTarget.IsTraining.mean": {
137
- "value": 1.0,
138
- "min": 1.0,
139
- "max": 1.0,
140
- "count": 8
141
- },
142
- "SnowballTarget.IsTraining.sum": {
143
- "value": 1.0,
144
- "min": 1.0,
145
- "max": 1.0,
146
- "count": 8
147
- }
148
- },
149
  "metadata": {
150
  "timer_format_version": "0.1.0",
151
- "start_time_seconds": "1718997522",
152
  "python_version": "3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0]",
153
  "command_line_arguments": "/usr/local/bin/mlagents-learn ./config/ppo/SnowballTarget.yaml --env=./training-envs-executables/linux/SnowballTarget/SnowballTarget --run-id=SnowballTarget1 --no-graphics --resume",
154
  "mlagents_version": "1.1.0.dev0",
@@ -156,162 +10,31 @@
156
  "communication_protocol_version": "1.5.0",
157
  "pytorch_version": "2.3.0+cu121",
158
  "numpy_version": "1.23.5",
159
- "end_time_seconds": "1718997702"
160
  },
161
- "total": 180.39630000399995,
162
  "count": 1,
163
- "self": 0.43558038700007273,
164
  "children": {
165
  "run_training.setup": {
166
- "total": 0.052241767999930744,
167
  "count": 1,
168
- "self": 0.052241767999930744
169
  },
170
  "TrainerController.start_learning": {
171
- "total": 179.90847784899995,
172
  "count": 1,
173
- "self": 0.22051091399600864,
174
  "children": {
175
  "TrainerController._reset_env": {
176
- "total": 2.0732255819999637,
177
  "count": 1,
178
- "self": 2.0732255819999637
179
- },
180
- "TrainerController.advance": {
181
- "total": 177.51990422100414,
182
- "count": 7275,
183
- "self": 0.10808270000336506,
184
- "children": {
185
- "env_step": {
186
- "total": 177.41182152100077,
187
- "count": 7275,
188
- "self": 113.96045126100182,
189
- "children": {
190
- "SubprocessEnvManager._take_step": {
191
- "total": 63.34373634499798,
192
- "count": 7275,
193
- "self": 0.5854479609987493,
194
- "children": {
195
- "TorchPolicy.evaluate": {
196
- "total": 62.75828838399923,
197
- "count": 7275,
198
- "self": 62.75828838399923
199
- }
200
- }
201
- },
202
- "workers": {
203
- "total": 0.10763391500097441,
204
- "count": 7275,
205
- "self": 0.0,
206
- "children": {
207
- "worker_root": {
208
- "total": 179.37576189899937,
209
- "count": 7275,
210
- "is_parallel": true,
211
- "self": 92.17300450599441,
212
- "children": {
213
- "run_training.setup": {
214
- "total": 0.0,
215
- "count": 0,
216
- "is_parallel": true,
217
- "self": 0.0,
218
- "children": {
219
- "steps_from_proto": {
220
- "total": 0.002336891000027208,
221
- "count": 1,
222
- "is_parallel": true,
223
- "self": 0.0006937159996596165,
224
- "children": {
225
- "_process_rank_one_or_two_observation": {
226
- "total": 0.0016431750003675916,
227
- "count": 10,
228
- "is_parallel": true,
229
- "self": 0.0016431750003675916
230
- }
231
- }
232
- },
233
- "UnityEnvironment.step": {
234
- "total": 0.03562714599991068,
235
- "count": 1,
236
- "is_parallel": true,
237
- "self": 0.0006605899999385656,
238
- "children": {
239
- "UnityEnvironment._generate_step_input": {
240
- "total": 0.00041509699997277494,
241
- "count": 1,
242
- "is_parallel": true,
243
- "self": 0.00041509699997277494
244
- },
245
- "communicator.exchange": {
246
- "total": 0.032640497999977924,
247
- "count": 1,
248
- "is_parallel": true,
249
- "self": 0.032640497999977924
250
- },
251
- "steps_from_proto": {
252
- "total": 0.0019109610000214161,
253
- "count": 1,
254
- "is_parallel": true,
255
- "self": 0.000353128000142533,
256
- "children": {
257
- "_process_rank_one_or_two_observation": {
258
- "total": 0.0015578329998788831,
259
- "count": 10,
260
- "is_parallel": true,
261
- "self": 0.0015578329998788831
262
- }
263
- }
264
- }
265
- }
266
- }
267
- }
268
- },
269
- "UnityEnvironment.step": {
270
- "total": 87.20275739300496,
271
- "count": 7274,
272
- "is_parallel": true,
273
- "self": 3.994698948999371,
274
- "children": {
275
- "UnityEnvironment._generate_step_input": {
276
- "total": 2.164636366001332,
277
- "count": 7274,
278
- "is_parallel": true,
279
- "self": 2.164636366001332
280
- },
281
- "communicator.exchange": {
282
- "total": 67.48164301599627,
283
- "count": 7274,
284
- "is_parallel": true,
285
- "self": 67.48164301599627
286
- },
287
- "steps_from_proto": {
288
- "total": 13.561779062007986,
289
- "count": 7274,
290
- "is_parallel": true,
291
- "self": 2.578936927033965,
292
- "children": {
293
- "_process_rank_one_or_two_observation": {
294
- "total": 10.982842134974021,
295
- "count": 72740,
296
- "is_parallel": true,
297
- "self": 10.982842134974021
298
- }
299
- }
300
- }
301
- }
302
- }
303
- }
304
- }
305
- }
306
- }
307
- }
308
- }
309
- }
310
  },
311
  "trainer_threads": {
312
- "total": 0.00020421899989742087,
313
  "count": 1,
314
- "self": 0.00020421899989742087,
315
  "children": {
316
  "thread_root": {
317
  "total": 0.0,
@@ -320,38 +43,16 @@
320
  "self": 0.0,
321
  "children": {
322
  "trainer_advance": {
323
- "total": 175.34581687400487,
324
- "count": 266159,
325
  "is_parallel": true,
326
- "self": 5.629605299994182,
327
  "children": {
328
  "process_trajectory": {
329
- "total": 95.89808049501062,
330
- "count": 266159,
331
- "is_parallel": true,
332
- "self": 95.59541508601069,
333
- "children": {
334
- "RLTrainer._checkpoint": {
335
- "total": 0.30266540899992833,
336
- "count": 2,
337
- "is_parallel": true,
338
- "self": 0.30266540899992833
339
- }
340
- }
341
- },
342
- "_update_policy": {
343
- "total": 73.81813107900007,
344
- "count": 36,
345
  "is_parallel": true,
346
- "self": 24.346703367000146,
347
- "children": {
348
- "TorchPPOOptimizer.update": {
349
- "total": 49.47142771199992,
350
- "count": 1833,
351
- "is_parallel": true,
352
- "self": 49.47142771199992
353
- }
354
- }
355
  }
356
  }
357
  }
@@ -360,14 +61,14 @@
360
  }
361
  },
362
  "TrainerController._save_models": {
363
- "total": 0.09463291299994125,
364
  "count": 1,
365
- "self": 0.001285301000052641,
366
  "children": {
367
  "RLTrainer._checkpoint": {
368
- "total": 0.09334761199988861,
369
  "count": 1,
370
- "self": 0.09334761199988861
371
  }
372
  }
373
  }
 
1
  {
2
  "name": "root",
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  "metadata": {
4
  "timer_format_version": "0.1.0",
5
+ "start_time_seconds": "1718997978",
6
  "python_version": "3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0]",
7
  "command_line_arguments": "/usr/local/bin/mlagents-learn ./config/ppo/SnowballTarget.yaml --env=./training-envs-executables/linux/SnowballTarget/SnowballTarget --run-id=SnowballTarget1 --no-graphics --resume",
8
  "mlagents_version": "1.1.0.dev0",
 
10
  "communication_protocol_version": "1.5.0",
11
  "pytorch_version": "2.3.0+cu121",
12
  "numpy_version": "1.23.5",
13
+ "end_time_seconds": "1718997981"
14
  },
15
+ "total": 3.234210953999991,
16
  "count": 1,
17
+ "self": 0.48716738100006296,
18
  "children": {
19
  "run_training.setup": {
20
+ "total": 0.08319931999994878,
21
  "count": 1,
22
+ "self": 0.08319931999994878
23
  },
24
  "TrainerController.start_learning": {
25
+ "total": 2.6638442529999793,
26
  "count": 1,
27
+ "self": 0.00035543199987841945,
28
  "children": {
29
  "TrainerController._reset_env": {
30
+ "total": 2.3600029990000166,
31
  "count": 1,
32
+ "self": 2.3600029990000166
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  },
34
  "trainer_threads": {
35
+ "total": 2.410799993413093e-05,
36
  "count": 1,
37
+ "self": 2.410799993413093e-05,
38
  "children": {
39
  "thread_root": {
40
  "total": 0.0,
 
43
  "self": 0.0,
44
  "children": {
45
  "trainer_advance": {
46
+ "total": 0.0002244360000531742,
47
+ "count": 1,
48
  "is_parallel": true,
49
+ "self": 1.6920000007303315e-05,
50
  "children": {
51
  "process_trajectory": {
52
+ "total": 0.0002075160000458709,
53
+ "count": 1,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
54
  "is_parallel": true,
55
+ "self": 0.0002075160000458709
 
 
 
 
 
 
 
 
56
  }
57
  }
58
  }
 
61
  }
62
  },
63
  "TrainerController._save_models": {
64
+ "total": 0.3034617140001501,
65
  "count": 1,
66
+ "self": 0.001119898000069952,
67
  "children": {
68
  "RLTrainer._checkpoint": {
69
+ "total": 0.30234181600008014,
70
  "count": 1,
71
+ "self": 0.30234181600008014
72
  }
73
  }
74
  }
run_logs/training_status.json CHANGED
@@ -36,13 +36,22 @@
36
  "auxillary_file_paths": [
37
  "results/SnowballTarget1/SnowballTarget/SnowballTarget-100152.pt"
38
  ]
 
 
 
 
 
 
 
 
 
39
  }
40
  ],
41
  "final_checkpoint": {
42
  "steps": 100152,
43
  "file_path": "results/SnowballTarget1/SnowballTarget.onnx",
44
- "reward": 17.818181818181817,
45
- "creation_time": 1718997702.2856228,
46
  "auxillary_file_paths": [
47
  "results/SnowballTarget1/SnowballTarget/SnowballTarget-100152.pt"
48
  ]
 
36
  "auxillary_file_paths": [
37
  "results/SnowballTarget1/SnowballTarget/SnowballTarget-100152.pt"
38
  ]
39
+ },
40
+ {
41
+ "steps": 100152,
42
+ "file_path": "results/SnowballTarget1/SnowballTarget/SnowballTarget-100152.onnx",
43
+ "reward": null,
44
+ "creation_time": 1718997981.1267493,
45
+ "auxillary_file_paths": [
46
+ "results/SnowballTarget1/SnowballTarget/SnowballTarget-100152.pt"
47
+ ]
48
  }
49
  ],
50
  "final_checkpoint": {
51
  "steps": 100152,
52
  "file_path": "results/SnowballTarget1/SnowballTarget.onnx",
53
+ "reward": null,
54
+ "creation_time": 1718997981.1267493,
55
  "auxillary_file_paths": [
56
  "results/SnowballTarget1/SnowballTarget/SnowballTarget-100152.pt"
57
  ]