Hugging Face's logo

pomeloD
/
ppo-Huggy

Reinforcement Learning
ml-agents
TensorBoard
ONNX
Huggy
deep-reinforcement-learning
ML-Agents-Huggy
Model card Files
xet
 Metrics Community
pomeloD commited on
Commit
cc004bb
·
verified ·
1 Parent(s): fa0459d

Huggy

Browse files
Files changed (14) hide show
  1. Huggy.onnx +1 -1
  2. Huggy/Huggy-1092139.onnx +3 -0
  3. Huggy/Huggy-1092139.pt +3 -0
  4. Huggy/Huggy-599970.onnx +3 -0
  5. Huggy/Huggy-599970.pt +3 -0
  6. Huggy/Huggy-799993.onnx +3 -0
  7. Huggy/Huggy-799993.pt +3 -0
  8. Huggy/Huggy-999913.onnx +3 -0
  9. Huggy/Huggy-999913.pt +3 -0
  10. Huggy/checkpoint.pt +1 -1
  11. Huggy/events.out.tfevents.1736929707.0779b60c6c76.14548.0 +3 -0
  12. run_logs/Player-0.log +14 -14
  13. run_logs/timers.json +167 -167
  14. run_logs/training_status.json +40 -4
Huggy.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2af87a3f671e0c19be46be589f58234c929930cb15cb4ba44f413ea3c9c2399c
3
  size 2274020
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:693cb02251c14d7bbe829765aa5be64b47da633e0cbc31a15d5f9eaec48f9e8d
3
  size 2274020
Huggy/Huggy-1092139.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:693cb02251c14d7bbe829765aa5be64b47da633e0cbc31a15d5f9eaec48f9e8d
3
+ size 2274020
Huggy/Huggy-1092139.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:576690bc8bb9860e8770d3789f1fdac2f5004492a7d1f5476dcfbad1aaea73d7
3
+ size 13509473
Huggy/Huggy-599970.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2c8b93b065388b84cb9b3d9ca1d82d411a5ed891d38cf49a4f73cea132a41e3
3
+ size 2274020
Huggy/Huggy-599970.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4cba1707a7ba503f0c8333cb07c2a56e1e50d8d6e0e7c20fc6603105c8083c3
3
+ size 13509388
Huggy/Huggy-799993.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf45023673b408ac4b204bb84bd81396394597dfe315dc4adfe636bf9b071f96
3
+ size 2274020
Huggy/Huggy-799993.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cff0342c2e998fd3879a49580257e0d5051596a93f73369761749f8cc2e0277
3
+ size 13509388
Huggy/Huggy-999913.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1291c54111bb0c5c278af69cc9818b0ed0e859381f9cd39fb6ea471d3cbfef69
3
+ size 2274020
Huggy/Huggy-999913.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad85080fce7651c907c6739cdfcb2511f52de37d9978d005ff590362455d3179
3
+ size 13509388
Huggy/checkpoint.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61f62b7c87aa6ed65ac8065190e4c0cccddda0c1d4edce7a8ad12b0fc3d2e3c1
3
  size 13509218
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:647c18f945d53e169c66029cd9d9323124ad44d0dc559ad649522237682ea06e
3
  size 13509218
Huggy/events.out.tfevents.1736929707.0779b60c6c76.14548.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c4f4a76dec81df04e0ac4bea58e0ae1cfc401edfe020c9ea4d0ca426200ea51
3
+ size 60265
run_logs/Player-0.log CHANGED
@@ -31,7 +31,7 @@ ALSA lib pcm.c:2664:(snd_pcm_open_noupdate) Unknown PCM default
31
  FMOD failed to initialize the output device.: "Error initializing output device. " (60)
32
  FMOD initialized on nosound output
33
  Begin MonoManager ReloadAssembly
34
- - Completed reload, in 0.095 seconds
35
  ERROR: Shader Hidden/Universal Render Pipeline/Blit shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
36
  ERROR: Shader Hidden/Universal Render Pipeline/CopyDepth shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
37
  ERROR: Shader Hidden/Universal Render Pipeline/ScreenSpaceShadows shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
@@ -75,14 +75,14 @@ ERROR: Shader Universal Render Pipeline/Lit shader is not supported on this GPU
75
  WARNING: Shader Unsupported: 'Universal Render Pipeline/Lit' - All subshaders removed
76
  WARNING: Shader Did you use #pragma only_renderers and omit this platform?
77
  WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
78
- UnloadTime: 0.830478 ms
79
  requesting resize 84 x 84
80
  Setting up 1 worker threads for Enlighten.
81
  Memory Statistics:
82
  [ALLOC_TEMP_TLS] TLS Allocator
83
  StackAllocators :
84
  [ALLOC_TEMP_MAIN]
85
- Peak usage frame count: [4.0 KB-8.0 KB]: 6719 frames, [2.0 MB-4.0 MB]: 1 frames
86
  Initial Block Size 4.0 MB
87
  Current Block Size 4.0 MB
88
  Peak Allocated Bytes 3.6 MB
@@ -198,22 +198,22 @@ Memory Statistics:
198
  Peak Allocated Bytes 0 B
199
  Overflow Count 0
200
  [ALLOC_DEFAULT] Dual Thread Allocator
201
- Peak main deferred allocation count 115
202
  [ALLOC_BUCKET]
203
  Large Block size 4.0 MB
204
  Used Block count 1
205
  Peak Allocated bytes 1.4 MB
206
  [ALLOC_DEFAULT_MAIN]
207
- Peak usage frame count: [16.0 MB-32.0 MB]: 6720 frames
208
  Requested Block Size 16.0 MB
209
  Peak Block count 1
210
- Peak Allocated memory 22.0 MB
211
  Peak Large allocation bytes 16.0 MB
212
  [ALLOC_DEFAULT_THREAD]
213
- Peak usage frame count: [2.0 MB-4.0 MB]: 6720 frames
214
  Requested Block Size 16.0 MB
215
  Peak Block count 1
216
- Peak Allocated memory 2.5 MB
217
  Peak Large allocation bytes 0 B
218
  [ALLOC_TEMP_JOB_1_FRAME]
219
  Initial Block Size 2.0 MB
@@ -242,13 +242,13 @@ Memory Statistics:
242
  Used Block count 1
243
  Peak Allocated bytes 1.4 MB
244
  [ALLOC_GFX_MAIN]
245
- Peak usage frame count: [32.0 KB-64.0 KB]: 6719 frames, [64.0 KB-128.0 KB]: 1 frames
246
  Requested Block Size 16.0 MB
247
  Peak Block count 1
248
  Peak Allocated memory 65.6 KB
249
  Peak Large allocation bytes 0 B
250
  [ALLOC_GFX_THREAD]
251
- Peak usage frame count: [64.0 KB-128.0 KB]: 6720 frames
252
  Requested Block Size 16.0 MB
253
  Peak Block count 1
254
  Peak Allocated memory 81.8 KB
@@ -260,13 +260,13 @@ Memory Statistics:
260
  Used Block count 1
261
  Peak Allocated bytes 1.4 MB
262
  [ALLOC_CACHEOBJECTS_MAIN]
263
- Peak usage frame count: [1.0 MB-2.0 MB]: 6719 frames, [16.0 MB-32.0 MB]: 1 frames
264
  Requested Block Size 4.0 MB
265
  Peak Block count 2
266
  Peak Allocated memory 30.6 MB
267
  Peak Large allocation bytes 24.9 MB
268
  [ALLOC_CACHEOBJECTS_THREAD]
269
- Peak usage frame count: [0.5 MB-1.0 MB]: 6719 frames, [2.0 MB-4.0 MB]: 1 frames
270
  Requested Block Size 4.0 MB
271
  Peak Block count 1
272
  Peak Allocated memory 2.6 MB
@@ -278,13 +278,13 @@ Memory Statistics:
278
  Used Block count 1
279
  Peak Allocated bytes 1.4 MB
280
  [ALLOC_TYPETREE_MAIN]
281
- Peak usage frame count: [0-1.0 KB]: 6720 frames
282
  Requested Block Size 2.0 MB
283
  Peak Block count 1
284
  Peak Allocated memory 1.0 KB
285
  Peak Large allocation bytes 0 B
286
  [ALLOC_TYPETREE_THREAD]
287
- Peak usage frame count: [4.0 KB-8.0 KB]: 6720 frames
288
  Requested Block Size 2.0 MB
289
  Peak Block count 1
290
  Peak Allocated memory 7.3 KB
 
31
  FMOD failed to initialize the output device.: "Error initializing output device. " (60)
32
  FMOD initialized on nosound output
33
  Begin MonoManager ReloadAssembly
34
+ - Completed reload, in 0.093 seconds
35
  ERROR: Shader Hidden/Universal Render Pipeline/Blit shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
36
  ERROR: Shader Hidden/Universal Render Pipeline/CopyDepth shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
37
  ERROR: Shader Hidden/Universal Render Pipeline/ScreenSpaceShadows shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
 
75
  WARNING: Shader Unsupported: 'Universal Render Pipeline/Lit' - All subshaders removed
76
  WARNING: Shader Did you use #pragma only_renderers and omit this platform?
77
  WARNING: Shader If subshaders removal was intentional, you may have forgotten turning Fallback off?
78
+ UnloadTime: 0.789489 ms
79
  requesting resize 84 x 84
80
  Setting up 1 worker threads for Enlighten.
81
  Memory Statistics:
82
  [ALLOC_TEMP_TLS] TLS Allocator
83
  StackAllocators :
84
  [ALLOC_TEMP_MAIN]
85
+ Peak usage frame count: [4.0 KB-8.0 KB]: 7778 frames, [2.0 MB-4.0 MB]: 1 frames
86
  Initial Block Size 4.0 MB
87
  Current Block Size 4.0 MB
88
  Peak Allocated Bytes 3.6 MB
 
198
  Peak Allocated Bytes 0 B
199
  Overflow Count 0
200
  [ALLOC_DEFAULT] Dual Thread Allocator
201
+ Peak main deferred allocation count 89
202
  [ALLOC_BUCKET]
203
  Large Block size 4.0 MB
204
  Used Block count 1
205
  Peak Allocated bytes 1.4 MB
206
  [ALLOC_DEFAULT_MAIN]
207
+ Peak usage frame count: [16.0 MB-32.0 MB]: 7779 frames
208
  Requested Block Size 16.0 MB
209
  Peak Block count 1
210
+ Peak Allocated memory 22.2 MB
211
  Peak Large allocation bytes 16.0 MB
212
  [ALLOC_DEFAULT_THREAD]
213
+ Peak usage frame count: [2.0 MB-4.0 MB]: 7779 frames
214
  Requested Block Size 16.0 MB
215
  Peak Block count 1
216
+ Peak Allocated memory 2.6 MB
217
  Peak Large allocation bytes 0 B
218
  [ALLOC_TEMP_JOB_1_FRAME]
219
  Initial Block Size 2.0 MB
 
242
  Used Block count 1
243
  Peak Allocated bytes 1.4 MB
244
  [ALLOC_GFX_MAIN]
245
+ Peak usage frame count: [32.0 KB-64.0 KB]: 7778 frames, [64.0 KB-128.0 KB]: 1 frames
246
  Requested Block Size 16.0 MB
247
  Peak Block count 1
248
  Peak Allocated memory 65.6 KB
249
  Peak Large allocation bytes 0 B
250
  [ALLOC_GFX_THREAD]
251
+ Peak usage frame count: [64.0 KB-128.0 KB]: 7779 frames
252
  Requested Block Size 16.0 MB
253
  Peak Block count 1
254
  Peak Allocated memory 81.8 KB
 
260
  Used Block count 1
261
  Peak Allocated bytes 1.4 MB
262
  [ALLOC_CACHEOBJECTS_MAIN]
263
+ Peak usage frame count: [1.0 MB-2.0 MB]: 7778 frames, [16.0 MB-32.0 MB]: 1 frames
264
  Requested Block Size 4.0 MB
265
  Peak Block count 2
266
  Peak Allocated memory 30.6 MB
267
  Peak Large allocation bytes 24.9 MB
268
  [ALLOC_CACHEOBJECTS_THREAD]
269
+ Peak usage frame count: [0.5 MB-1.0 MB]: 7778 frames, [2.0 MB-4.0 MB]: 1 frames
270
  Requested Block Size 4.0 MB
271
  Peak Block count 1
272
  Peak Allocated memory 2.6 MB
 
278
  Used Block count 1
279
  Peak Allocated bytes 1.4 MB
280
  [ALLOC_TYPETREE_MAIN]
281
+ Peak usage frame count: [0-1.0 KB]: 7779 frames
282
  Requested Block Size 2.0 MB
283
  Peak Block count 1
284
  Peak Allocated memory 1.0 KB
285
  Peak Large allocation bytes 0 B
286
  [ALLOC_TYPETREE_THREAD]
287
+ Peak usage frame count: [4.0 KB-8.0 KB]: 7779 frames
288
  Requested Block Size 2.0 MB
289
  Peak Block count 1
290
  Peak Allocated memory 7.3 KB
run_logs/timers.json CHANGED
@@ -2,153 +2,153 @@
2
  "name": "root",
3
  "gauges": {
4
  "Huggy.Policy.Entropy.mean": {
5
- "value": 1.4190422296524048,
6
- "min": 1.4190422296524048,
7
- "max": 1.4250876903533936,
8
- "count": 10
9
  },
10
  "Huggy.Policy.Entropy.sum": {
11
- "value": 70891.09375,
12
- "min": 63498.87109375,
13
- "max": 72457.15625,
14
- "count": 10
15
  },
16
  "Huggy.Environment.EpisodeLength.mean": {
17
- "value": 113.47368421052632,
18
- "min": 113.47368421052632,
19
- "max": 389.59615384615387,
20
- "count": 10
21
  },
22
  "Huggy.Environment.EpisodeLength.sum": {
23
- "value": 49588.0,
24
- "min": 40518.0,
25
- "max": 50288.0,
26
- "count": 10
27
  },
28
  "Huggy.Step.mean": {
29
- "value": 499913.0,
30
- "min": 49297.0,
31
- "max": 499913.0,
32
- "count": 10
33
  },
34
  "Huggy.Step.sum": {
35
- "value": 499913.0,
36
- "min": 49297.0,
37
- "max": 499913.0,
38
- "count": 10
39
  },
40
  "Huggy.Policy.ExtrinsicValueEstimate.mean": {
41
- "value": 2.1788582801818848,
42
- "min": 0.04198251664638519,
43
- "max": 2.1788582801818848,
44
- "count": 10
45
  },
46
  "Huggy.Policy.ExtrinsicValueEstimate.sum": {
47
- "value": 952.1610717773438,
48
- "min": 4.324199199676514,
49
- "max": 952.1610717773438,
50
- "count": 10
51
  },
52
  "Huggy.Environment.CumulativeReward.mean": {
53
- "value": 3.830079616821058,
54
- "min": 1.7462001202754605,
55
- "max": 4.031612083813831,
56
- "count": 10
57
  },
58
  "Huggy.Environment.CumulativeReward.sum": {
59
- "value": 1673.7447925508022,
60
- "min": 179.85861238837242,
61
- "max": 1673.7447925508022,
62
- "count": 10
63
  },
64
  "Huggy.Policy.ExtrinsicReward.mean": {
65
- "value": 3.830079616821058,
66
- "min": 1.7462001202754605,
67
- "max": 4.031612083813831,
68
- "count": 10
69
  },
70
  "Huggy.Policy.ExtrinsicReward.sum": {
71
- "value": 1673.7447925508022,
72
- "min": 179.85861238837242,
73
- "max": 1673.7447925508022,
74
- "count": 10
75
  },
76
  "Huggy.Losses.PolicyLoss.mean": {
77
- "value": 0.017336433089803906,
78
- "min": 0.014320030546009041,
79
- "max": 0.020833562784052143,
80
- "count": 10
81
  },
82
  "Huggy.Losses.PolicyLoss.sum": {
83
- "value": 0.03467286617960781,
84
- "min": 0.020833562784052143,
85
- "max": 0.052766499834615385,
86
- "count": 10
87
  },
88
  "Huggy.Losses.ValueLoss.mean": {
89
- "value": 0.03799693329880635,
90
- "min": 0.022262288505832353,
91
- "max": 0.04358985579262177,
92
- "count": 10
93
  },
94
  "Huggy.Losses.ValueLoss.sum": {
95
- "value": 0.0759938665976127,
96
- "min": 0.04358985579262177,
97
- "max": 0.11701987441629172,
98
- "count": 10
99
  },
100
  "Huggy.Policy.LearningRate.mean": {
101
- "value": 0.000305149723712575,
102
- "min": 0.000305149723712575,
103
- "max": 0.00039399960150010013,
104
- "count": 10
105
  },
106
  "Huggy.Policy.LearningRate.sum": {
107
- "value": 0.00061029944742515,
108
- "min": 0.00039399960150010013,
109
- "max": 0.0011568816107796003,
110
- "count": 10
111
  },
112
  "Huggy.Policy.Epsilon.mean": {
113
- "value": 0.176287425,
114
- "min": 0.176287425,
115
- "max": 0.19849989999999995,
116
- "count": 10
117
  },
118
  "Huggy.Policy.Epsilon.sum": {
119
- "value": 0.35257485,
120
- "min": 0.19849989999999995,
121
- "max": 0.5892204000000001,
122
- "count": 10
123
  },
124
  "Huggy.Policy.Beta.mean": {
125
- "value": 0.003816742507500002,
126
- "min": 0.003816742507500002,
127
- "max": 0.004925145009999998,
128
- "count": 10
129
  },
130
  "Huggy.Policy.Beta.sum": {
131
- "value": 0.007633485015000004,
132
- "min": 0.004925145009999998,
133
- "max": 0.014462097960000002,
134
- "count": 10
135
  },
136
  "Huggy.IsTraining.mean": {
137
  "value": 1.0,
138
  "min": 1.0,
139
  "max": 1.0,
140
- "count": 10
141
  },
142
  "Huggy.IsTraining.sum": {
143
  "value": 1.0,
144
  "min": 1.0,
145
  "max": 1.0,
146
- "count": 10
147
  }
148
  },
149
  "metadata": {
150
  "timer_format_version": "0.1.0",
151
- "start_time_seconds": "1736928461",
152
  "python_version": "3.10.12 (main, Nov 6 2024, 20:22:13) [GCC 11.4.0]",
153
  "command_line_arguments": "/usr/local/bin/mlagents-learn ./config/ppo/Huggy.yaml --env=./trained-envs-executables/linux/Huggy/Huggy --run-id=Huggy2 --no-graphics --resume",
154
  "mlagents_version": "1.2.0.dev0",
@@ -156,59 +156,59 @@
156
  "communication_protocol_version": "1.5.0",
157
  "pytorch_version": "2.5.1+cu121",
158
  "numpy_version": "1.23.5",
159
- "end_time_seconds": "1736929151"
160
  },
161
- "total": 690.1705263700001,
162
  "count": 1,
163
- "self": 0.26756672200008325,
164
  "children": {
165
  "run_training.setup": {
166
- "total": 0.060188609000306315,
167
  "count": 1,
168
- "self": 0.060188609000306315
169
  },
170
  "TrainerController.start_learning": {
171
- "total": 689.8427710389997,
172
  "count": 1,
173
- "self": 1.2803969640613104,
174
  "children": {
175
  "TrainerController._reset_env": {
176
- "total": 2.1697141549998378,
177
  "count": 1,
178
- "self": 2.1697141549998378
179
  },
180
  "TrainerController.advance": {
181
- "total": 686.1896143319382,
182
- "count": 57447,
183
- "self": 1.314082940940807,
184
  "children": {
185
  "env_step": {
186
- "total": 556.8092361580402,
187
- "count": 57447,
188
- "self": 437.53755228413775,
189
  "children": {
190
  "SubprocessEnvManager._take_step": {
191
- "total": 118.45669438204504,
192
- "count": 57447,
193
- "self": 4.305640458034759,
194
  "children": {
195
  "TorchPolicy.evaluate": {
196
- "total": 114.15105392401028,
197
- "count": 55994,
198
- "self": 114.15105392401028
199
  }
200
  }
201
  },
202
  "workers": {
203
- "total": 0.8149894918574319,
204
- "count": 57446,
205
  "self": 0.0,
206
  "children": {
207
  "worker_root": {
208
- "total": 687.6982669689774,
209
- "count": 57446,
210
  "is_parallel": true,
211
- "self": 331.744342757941,
212
  "children": {
213
  "run_training.setup": {
214
  "total": 0.0,
@@ -217,48 +217,48 @@
217
  "self": 0.0,
218
  "children": {
219
  "steps_from_proto": {
220
- "total": 0.0010421269998914795,
221
  "count": 1,
222
  "is_parallel": true,
223
- "self": 0.00030624500004705624,
224
  "children": {
225
  "_process_rank_one_or_two_observation": {
226
- "total": 0.0007358819998444233,
227
  "count": 2,
228
  "is_parallel": true,
229
- "self": 0.0007358819998444233
230
  }
231
  }
232
  },
233
  "UnityEnvironment.step": {
234
- "total": 0.030213659999844822,
235
  "count": 1,
236
  "is_parallel": true,
237
- "self": 0.000411865999467409,
238
  "children": {
239
  "UnityEnvironment._generate_step_input": {
240
- "total": 0.00025261800010412117,
241
  "count": 1,
242
  "is_parallel": true,
243
- "self": 0.00025261800010412117
244
  },
245
  "communicator.exchange": {
246
- "total": 0.02877581700022347,
247
  "count": 1,
248
  "is_parallel": true,
249
- "self": 0.02877581700022347
250
  },
251
  "steps_from_proto": {
252
- "total": 0.0007733590000498225,
253
  "count": 1,
254
  "is_parallel": true,
255
- "self": 0.00021840700037500937,
256
  "children": {
257
  "_process_rank_one_or_two_observation": {
258
- "total": 0.0005549519996748131,
259
  "count": 2,
260
  "is_parallel": true,
261
- "self": 0.0005549519996748131
262
  }
263
  }
264
  }
@@ -267,34 +267,34 @@
267
  }
268
  },
269
  "UnityEnvironment.step": {
270
- "total": 355.95392421103634,
271
- "count": 57445,
272
  "is_parallel": true,
273
- "self": 10.389698987031807,
274
  "children": {
275
  "UnityEnvironment._generate_step_input": {
276
- "total": 23.767190306059092,
277
- "count": 57445,
278
  "is_parallel": true,
279
- "self": 23.767190306059092
280
  },
281
  "communicator.exchange": {
282
- "total": 296.7199569759473,
283
- "count": 57445,
284
  "is_parallel": true,
285
- "self": 296.7199569759473
286
  },
287
  "steps_from_proto": {
288
- "total": 25.07707794199814,
289
- "count": 57445,
290
  "is_parallel": true,
291
- "self": 9.550197338021462,
292
  "children": {
293
  "_process_rank_one_or_two_observation": {
294
- "total": 15.526880603976679,
295
- "count": 114890,
296
  "is_parallel": true,
297
- "self": 15.526880603976679
298
  }
299
  }
300
  }
@@ -307,31 +307,31 @@
307
  }
308
  },
309
  "trainer_advance": {
310
- "total": 128.06629523295715,
311
- "count": 57446,
312
- "self": 1.8541531419550665,
313
  "children": {
314
  "process_trajectory": {
315
- "total": 38.21958914600373,
316
- "count": 57446,
317
- "self": 37.92409228000406,
318
  "children": {
319
  "RLTrainer._checkpoint": {
320
- "total": 0.2954968659996666,
321
- "count": 2,
322
- "self": 0.2954968659996666
323
  }
324
  }
325
  },
326
  "_update_policy": {
327
- "total": 87.99255294499835,
328
- "count": 24,
329
- "self": 70.93867519599189,
330
  "children": {
331
  "TorchPPOOptimizer.update": {
332
- "total": 17.05387774900646,
333
- "count": 720,
334
- "self": 17.05387774900646
335
  }
336
  }
337
  }
@@ -340,19 +340,19 @@
340
  }
341
  },
342
  "trainer_threads": {
343
- "total": 1.5650002751499414e-06,
344
  "count": 1,
345
- "self": 1.5650002751499414e-06
346
  },
347
  "TrainerController._save_models": {
348
- "total": 0.20304402300007496,
349
  "count": 1,
350
- "self": 0.006738720999692305,
351
  "children": {
352
  "RLTrainer._checkpoint": {
353
- "total": 0.19630530200038265,
354
  "count": 1,
355
- "self": 0.19630530200038265
356
  }
357
  }
358
  }
 
2
  "name": "root",
3
  "gauges": {
4
  "Huggy.Policy.Entropy.mean": {
5
+ "value": 1.4004923105239868,
6
+ "min": 1.4004923105239868,
7
+ "max": 1.416495680809021,
8
+ "count": 11
9
  },
10
  "Huggy.Policy.Entropy.sum": {
11
+ "value": 70303.3125,
12
+ "min": 57523.890625,
13
+ "max": 70643.328125,
14
+ "count": 11
15
  },
16
  "Huggy.Environment.EpisodeLength.mean": {
17
+ "value": 78.61049284578696,
18
+ "min": 78.61049284578696,
19
+ "max": 103.71757322175732,
20
+ "count": 11
21
  },
22
  "Huggy.Environment.EpisodeLength.sum": {
23
+ "value": 49446.0,
24
+ "min": 38414.0,
25
+ "max": 49632.0,
26
+ "count": 11
27
  },
28
  "Huggy.Step.mean": {
29
+ "value": 1049984.0,
30
+ "min": 549870.0,
31
+ "max": 1049984.0,
32
+ "count": 11
33
  },
34
  "Huggy.Step.sum": {
35
+ "value": 1049984.0,
36
+ "min": 549870.0,
37
+ "max": 1049984.0,
38
+ "count": 11
39
  },
40
  "Huggy.Policy.ExtrinsicValueEstimate.mean": {
41
+ "value": 2.419528007507324,
42
+ "min": 2.221865177154541,
43
+ "max": 2.4539589881896973,
44
+ "count": 11
45
  },
46
  "Huggy.Policy.ExtrinsicValueEstimate.sum": {
47
+ "value": 1521.883056640625,
48
+ "min": 850.974365234375,
49
+ "max": 1521.883056640625,
50
+ "count": 11
51
  },
52
  "Huggy.Environment.CumulativeReward.mean": {
53
+ "value": 3.948714923593312,
54
+ "min": 3.7184909826470416,
55
+ "max": 4.0614491759501785,
56
+ "count": 11
57
  },
58
  "Huggy.Environment.CumulativeReward.sum": {
59
+ "value": 2483.741686940193,
60
+ "min": 1424.182046353817,
61
+ "max": 2483.741686940193,
62
+ "count": 11
63
  },
64
  "Huggy.Policy.ExtrinsicReward.mean": {
65
+ "value": 3.948714923593312,
66
+ "min": 3.7184909826470416,
67
+ "max": 4.0614491759501785,
68
+ "count": 11
69
  },
70
  "Huggy.Policy.ExtrinsicReward.sum": {
71
+ "value": 2483.741686940193,
72
+ "min": 1424.182046353817,
73
+ "max": 2483.741686940193,
74
+ "count": 11
75
  },
76
  "Huggy.Losses.PolicyLoss.mean": {
77
+ "value": 0.01748199050974411,
78
+ "min": 0.013826595443242697,
79
+ "max": 0.01878047747692714,
80
+ "count": 11
81
  },
82
  "Huggy.Losses.PolicyLoss.sum": {
83
+ "value": 0.05244597152923233,
84
+ "min": 0.01878047747692714,
85
+ "max": 0.05244597152923233,
86
+ "count": 11
87
  },
88
  "Huggy.Losses.ValueLoss.mean": {
89
+ "value": 0.05017157453629706,
90
+ "min": 0.03735943231731653,
91
+ "max": 0.055835366186996305,
92
+ "count": 11
93
  },
94
  "Huggy.Losses.ValueLoss.sum": {
95
+ "value": 0.15051472360889118,
96
+ "min": 0.03735943231731653,
97
+ "max": 0.15477257072925568,
98
+ "count": 11
99
  },
100
  "Huggy.Policy.LearningRate.mean": {
101
+ "value": 0.00019507745123065006,
102
+ "min": 0.00019507745123065006,
103
+ "max": 0.00029365862658535004,
104
+ "count": 11
105
  },
106
  "Huggy.Policy.LearningRate.sum": {
107
+ "value": 0.0005852323536919502,
108
+ "min": 0.00029365862658535004,
109
+ "max": 0.0008563180859205001,
110
+ "count": 11
111
  },
112
  "Huggy.Policy.Epsilon.mean": {
113
+ "value": 0.14876935,
114
+ "min": 0.14876935,
115
+ "max": 0.17341464999999995,
116
+ "count": 11
117
  },
118
  "Huggy.Policy.Epsilon.sum": {
119
+ "value": 0.44630805,
120
+ "min": 0.17341464999999995,
121
+ "max": 0.5140794999999999,
122
+ "count": 11
123
  },
124
  "Huggy.Policy.Beta.mean": {
125
+ "value": 0.002443590565,
126
+ "min": 0.002443590565,
127
+ "max": 0.0036733910350000005,
128
+ "count": 11
129
  },
130
  "Huggy.Policy.Beta.sum": {
131
+ "value": 0.007330771695000001,
132
+ "min": 0.0036733910350000005,
133
+ "max": 0.010712567050000003,
134
+ "count": 11
135
  },
136
  "Huggy.IsTraining.mean": {
137
  "value": 1.0,
138
  "min": 1.0,
139
  "max": 1.0,
140
+ "count": 11
141
  },
142
  "Huggy.IsTraining.sum": {
143
  "value": 1.0,
144
  "min": 1.0,
145
  "max": 1.0,
146
+ "count": 11
147
  }
148
  },
149
  "metadata": {
150
  "timer_format_version": "0.1.0",
151
+ "start_time_seconds": "1736929706",
152
  "python_version": "3.10.12 (main, Nov 6 2024, 20:22:13) [GCC 11.4.0]",
153
  "command_line_arguments": "/usr/local/bin/mlagents-learn ./config/ppo/Huggy.yaml --env=./trained-envs-executables/linux/Huggy/Huggy --run-id=Huggy2 --no-graphics --resume",
154
  "mlagents_version": "1.2.0.dev0",
 
156
  "communication_protocol_version": "1.5.0",
157
  "pytorch_version": "2.5.1+cu121",
158
  "numpy_version": "1.23.5",
159
+ "end_time_seconds": "1736930526"
160
  },
161
+ "total": 819.5938184930001,
162
  "count": 1,
163
+ "self": 0.4889176730002873,
164
  "children": {
165
  "run_training.setup": {
166
+ "total": 0.06257531600022048,
167
  "count": 1,
168
+ "self": 0.06257531600022048
169
  },
170
  "TrainerController.start_learning": {
171
+ "total": 819.0423255039996,
172
  "count": 1,
173
+ "self": 1.564728843015473,
174
  "children": {
175
  "TrainerController._reset_env": {
176
+ "total": 2.827155825999853,
177
  "count": 1,
178
+ "self": 2.827155825999853
179
  },
180
  "TrainerController.advance": {
181
+ "total": 814.296567508984,
182
+ "count": 68042,
183
+ "self": 1.5438582498632059,
184
  "children": {
185
  "env_step": {
186
+ "total": 650.9159495670538,
187
+ "count": 68042,
188
+ "self": 513.7855092340533,
189
  "children": {
190
  "SubprocessEnvManager._take_step": {
191
+ "total": 136.13149663800596,
192
+ "count": 68042,
193
+ "self": 5.0998871220626825,
194
  "children": {
195
  "TorchPolicy.evaluate": {
196
+ "total": 131.03160951594327,
197
+ "count": 64825,
198
+ "self": 131.03160951594327
199
  }
200
  }
201
  },
202
  "workers": {
203
+ "total": 0.998943694994523,
204
+ "count": 68041,
205
  "self": 0.0,
206
  "children": {
207
  "worker_root": {
208
+ "total": 816.3970834299689,
209
+ "count": 68041,
210
  "is_parallel": true,
211
+ "self": 400.21557570497225,
212
  "children": {
213
  "run_training.setup": {
214
  "total": 0.0,
 
217
  "self": 0.0,
218
  "children": {
219
  "steps_from_proto": {
220
+ "total": 0.0012202699999761535,
221
  "count": 1,
222
  "is_parallel": true,
223
+ "self": 0.0003550239998730831,
224
  "children": {
225
  "_process_rank_one_or_two_observation": {
226
+ "total": 0.0008652460001030704,
227
  "count": 2,
228
  "is_parallel": true,
229
+ "self": 0.0008652460001030704
230
  }
231
  }
232
  },
233
  "UnityEnvironment.step": {
234
+ "total": 0.08778650800013565,
235
  "count": 1,
236
  "is_parallel": true,
237
+ "self": 0.0004195880005681829,
238
  "children": {
239
  "UnityEnvironment._generate_step_input": {
240
+ "total": 0.0002139399998668523,
241
  "count": 1,
242
  "is_parallel": true,
243
+ "self": 0.0002139399998668523
244
  },
245
  "communicator.exchange": {
246
+ "total": 0.08637903499993627,
247
  "count": 1,
248
  "is_parallel": true,
249
+ "self": 0.08637903499993627
250
  },
251
  "steps_from_proto": {
252
+ "total": 0.0007739449997643533,
253
  "count": 1,
254
  "is_parallel": true,
255
+ "self": 0.00022043199987820117,
256
  "children": {
257
  "_process_rank_one_or_two_observation": {
258
+ "total": 0.0005535129998861521,
259
  "count": 2,
260
  "is_parallel": true,
261
+ "self": 0.0005535129998861521
262
  }
263
  }
264
  }
 
267
  }
268
  },
269
  "UnityEnvironment.step": {
270
+ "total": 416.18150772499666,
271
+ "count": 68040,
272
  "is_parallel": true,
273
+ "self": 12.18836632217608,
274
  "children": {
275
  "UnityEnvironment._generate_step_input": {
276
+ "total": 27.205305307858907,
277
+ "count": 68040,
278
  "is_parallel": true,
279
+ "self": 27.205305307858907
280
  },
281
  "communicator.exchange": {
282
+ "total": 347.05537549097926,
283
+ "count": 68040,
284
  "is_parallel": true,
285
+ "self": 347.05537549097926
286
  },
287
  "steps_from_proto": {
288
+ "total": 29.732460603982418,
289
+ "count": 68040,
290
  "is_parallel": true,
291
+ "self": 11.446489211060907,
292
  "children": {
293
  "_process_rank_one_or_two_observation": {
294
+ "total": 18.28597139292151,
295
+ "count": 136080,
296
  "is_parallel": true,
297
+ "self": 18.28597139292151
298
  }
299
  }
300
  }
 
307
  }
308
  },
309
  "trainer_advance": {
310
+ "total": 161.83675969206706,
311
+ "count": 68041,
312
+ "self": 2.1776372660538073,
313
  "children": {
314
  "process_trajectory": {
315
+ "total": 60.68871669501459,
316
+ "count": 68041,
317
+ "self": 60.23903322301385,
318
  "children": {
319
  "RLTrainer._checkpoint": {
320
+ "total": 0.44968347200074277,
321
+ "count": 3,
322
+ "self": 0.44968347200074277
323
  }
324
  }
325
  },
326
  "_update_policy": {
327
+ "total": 98.97040573099866,
328
+ "count": 28,
329
+ "self": 79.00905614000658,
330
  "children": {
331
  "TorchPPOOptimizer.update": {
332
+ "total": 19.961349590992086,
333
+ "count": 840,
334
+ "self": 19.961349590992086
335
  }
336
  }
337
  }
 
340
  }
341
  },
342
  "trainer_threads": {
343
+ "total": 1.5169998732744716e-06,
344
  "count": 1,
345
+ "self": 1.5169998732744716e-06
346
  },
347
  "TrainerController._save_models": {
348
+ "total": 0.35387180900033854,
349
  "count": 1,
350
+ "self": 0.01067921100093372,
351
  "children": {
352
  "RLTrainer._checkpoint": {
353
+ "total": 0.3431925979994048,
354
  "count": 1,
355
+ "self": 0.3431925979994048
356
  }
357
  }
358
  }
run_logs/training_status.json CHANGED
@@ -36,15 +36,51 @@
36
  "auxillary_file_paths": [
37
  "results/Huggy2/Huggy/Huggy-511223.pt"
38
  ]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  }
40
  ],
41
  "final_checkpoint": {
42
- "steps": 511223,
43
  "file_path": "results/Huggy2/Huggy.onnx",
44
- "reward": 3.6433242857456207,
45
- "creation_time": 1736929151.431713,
46
  "auxillary_file_paths": [
47
- "results/Huggy2/Huggy/Huggy-511223.pt"
48
  ]
49
  }
50
  },
 
36
  "auxillary_file_paths": [
37
  "results/Huggy2/Huggy/Huggy-511223.pt"
38
  ]
39
+ },
40
+ {
41
+ "steps": 599970,
42
+ "file_path": "results/Huggy2/Huggy/Huggy-599970.onnx",
43
+ "reward": 3.724841483651775,
44
+ "creation_time": 1736929833.6556406,
45
+ "auxillary_file_paths": [
46
+ "results/Huggy2/Huggy/Huggy-599970.pt"
47
+ ]
48
+ },
49
+ {
50
+ "steps": 799993,
51
+ "file_path": "results/Huggy2/Huggy/Huggy-799993.onnx",
52
+ "reward": 3.7299718111753464,
53
+ "creation_time": 1736930113.793764,
54
+ "auxillary_file_paths": [
55
+ "results/Huggy2/Huggy/Huggy-799993.pt"
56
+ ]
57
+ },
58
+ {
59
+ "steps": 999913,
60
+ "file_path": "results/Huggy2/Huggy/Huggy-999913.onnx",
61
+ "reward": 3.9692751006382267,
62
+ "creation_time": 1736930393.5161602,
63
+ "auxillary_file_paths": [
64
+ "results/Huggy2/Huggy/Huggy-999913.pt"
65
+ ]
66
+ },
67
+ {
68
+ "steps": 1092139,
69
+ "file_path": "results/Huggy2/Huggy/Huggy-1092139.onnx",
70
+ "reward": 4.114423428972562,
71
+ "creation_time": 1736930525.7572753,
72
+ "auxillary_file_paths": [
73
+ "results/Huggy2/Huggy/Huggy-1092139.pt"
74
+ ]
75
  }
76
  ],
77
  "final_checkpoint": {
78
+ "steps": 1092139,
79
  "file_path": "results/Huggy2/Huggy.onnx",
80
+ "reward": 4.114423428972562,
81
+ "creation_time": 1736930525.7572753,
82
  "auxillary_file_paths": [
83
+ "results/Huggy2/Huggy/Huggy-1092139.pt"
84
  ]
85
  }
86
  },