112550099NYCU commited on
Commit
e7df1d4
·
verified ·
1 Parent(s): ed878e3

Upload rollout file dining_act_v1_9_200k_eval100_with_video.log

Browse files
rollout/dining_act_v1_9_200k_eval100_with_video.log ADDED
@@ -0,0 +1,266 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [INFO][AppLauncher]: Using device: cuda
2
+ [INFO][AppLauncher]: Loading experience file: /workspace/aicapstone/dependencies/IsaacLab/apps/isaaclab.python.rendering.kit
3
+ Loading user config located at: '/usr/local/lib/python3.11/dist-packages/isaacsim/kit/data/Kit/Isaac-Sim/5.1/user.config.json'
4
+ [Info] [carb] Logging to file: /usr/local/lib/python3.11/dist-packages/isaacsim/kit/logs/Kit/Isaac-Sim/5.1/kit_20260605_044341.log
5
+
6
+ |---------------------------------------------------------------------------------------------|
7
+ | Driver Version: 580.159.03 | Graphics API: Vulkan
8
+ |=============================================================================================|
9
+ | GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
10
+ | | | | | | Device-ID | UUID |
11
+ | | | | | | Bus-ID | |
12
+ |---------------------------------------------------------------------------------------------|
13
+ | 0 | NVIDIA GeForce RTX 5090 | Yes: 0 | | 32607 MB | 10de | 0 |
14
+ | | | | | | 2b85 | c6b4ac3e.. |
15
+ | | | | | | 1 | |
16
+ |=============================================================================================|
17
+ | OS: 22.04.5 LTS (Jammy Jellyfish) ubuntu, Version: 22.04.5, Kernel: 6.17.0-29-generic
18
+ | XServer Vendor: The X.Org Foundation, XServer Version: 12101011 (1.21.1.11)
19
+ | Processor: AMD Ryzen 9 9900X 12-Core Processor
20
+ | Cores: 12 | Logical Cores: 24
21
+ |---------------------------------------------------------------------------------------------|
22
+ | Total Memory (MB): 61922 | Free Memory: 58295
23
+ | Total Page/Swap (MB): 8191 | Free Page/Swap: 0
24
+ |---------------------------------------------------------------------------------------------|
25
+ 2026-06-05T04:43:42Z [655ms] [Warning] [gpu.foundation.plugin] PCIe link width current (8) and maximum (16) for device 0 don't match.
26
+ 2026-06-05T04:43:42Z [655ms] [Warning] [gpu.foundation.plugin] IOMMU is enabled.
27
+ 2026-06-05T04:43:42Z [1,256ms] [Warning] [omni.log] Source: omni.hydra was already registered.
28
+ 2026-06-05T04:43:43Z [1,369ms] [Warning] [carb] Acquiring non optional plugin interface which is not listed as dependency: [omni::physx::IPhysxBenchmarks v1.0] (plugin: <default plugin>), by client: omni.physics.physx.plugin. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client.
29
+ 2026-06-05T04:43:43Z [1,408ms] [Warning] [omni.isaac.dynamic_control] omni.isaac.dynamic_control is deprecated as of Isaac Sim 4.5. No action is needed from end-users.
30
+ 2026-06-05T04:43:44Z [2,708ms] [Warning] [pxr.Semantics] pxr.Semantics is deprecated - please use Semantics instead
31
+ 2026-06-05T04:43:44Z [2,907ms] [Warning] [omni.graph.core.plugin] Found duplicate of category 'Replicator' - was 'Annotators', adding 'Fabric Reader'
32
+ 2026-06-05T04:43:44Z [2,907ms] [Warning] [omni.graph.core.plugin] Category 'Replicator' not accepted on node type 'omni.replicator.core.FabricReader' in extension 'omni.replicator.core'
33
+ 2026-06-05T04:43:44Z [2,907ms] [Warning] [omni.replicator.core.scripts.extension] No material configuration file, adding configuration to material settings directly.
34
+ 2026-06-05T04:43:45Z [4,026ms] [Warning] [omni.fabric.plugin] Warning: attribute viewportHandle not found for bucket id 9
35
+
36
+ 2026-06-05T04:43:45Z [4,042ms] [Warning] [rtx.neuraylib.plugin] [LINK:PLUGIN] 0.0 LINK plug warn : Loading /usr/local/lib/python3.11/dist-packages/isaacsim/extscache/omni.iray.libs-0.0.0+69cbf6ad.lx64.r/bin/iray/nvcuvid_video_decoder.so: libnvcuvid.so.1: cannot open shared object file: No such file or directory
37
+ 2026-06-05T04:43:45Z [4,042ms] [Warning] [rtx.neuraylib.plugin] [LINK:PLUGIN] 0.0 LINK plug warn : Loading .\nt-x86-64\lib\nvcuvid_video_decoder.so: .\nt-x86-64\lib\nvcuvid_video_decoder.so: cannot open shared object file: No such file or directory
38
+ 2026-06-05T04:43:45Z [4,042ms] [Warning] [rtx.neuraylib.plugin] Failed to load nvcuvid h264 decoder plugin. Iray Bridge h264 support will not be available.
39
+ 2026-06-05T04:43:46Z [4,350ms] [Warning] [carb.graphics-vulkan.plugin] Trying to initialize NGX without vkGetInstanceProcAddr and vkGetDeviceProcAddr pointer-to-functions.
40
+ 2026-06-05T04:43:46Z [4,350ms] [Error] [carb.graphics-vulkan.plugin] Could not get NGX parameters block because NGX isn't enabled.
41
+ 2026-06-05T04:43:46Z [4,350ms] [Error] [carb.graphics-vulkan.plugin] Failed to create NGX context.
42
+ 2026-06-05T04:43:46Z [4,350ms] [Warning] [carb.scenerenderer-rtx.plugin] Failed to create NGX context.
43
+ [INFO]: Parsing configuration from: simulator.tasks.dining_cleanup.dining_cleanup_env_cfg:DiningCleanupEnvCfg
44
+ [rollout] loaded 100 object pose episodes from data/dining_clean/dining_cleanup_object_poses_100.json
45
+
46
+ ======================================================================================
47
+ [INFO][IsaacLab]: Logging to file: /tmp/isaaclab/logs/isaaclab_2026-06-05_04-43-49.log
48
+ ======================================================================================
49
+
50
+ 04:43:49 [simulation_context.py] WARNING: The `enable_external_forces_every_iteration` parameter in the PhysxCfg is set to False. If you are experiencing noisy velocities, consider enabling this flag. You may need to slightly increase the number of velocity iterations (setting it to 1 or 2 rather than 0), together with this flag, to improve the accuracy of velocity updates.
51
+ [INFO]: Base environment:
52
+ Environment device : cuda:0
53
+ Environment seed : 2026053002
54
+ Physics step-size : 0.016666666666666666
55
+ Rendering step-size : 0.016666666666666666
56
+ Environment step-size : 0.016666666666666666
57
+ [INFO]: Time taken for scene creation : 1.681420 seconds
58
+ [INFO]: Scene manager: <class InteractiveScene>
59
+ Number of environments: 1
60
+ Environment spacing : 8.0
61
+ Source prim name : /World/envs/env_0
62
+ Global prim paths : []
63
+ Replicate physics : True
64
+ [INFO]: Starting the simulation. This may take a few seconds. Please wait...
65
+ 2026-06-05T04:43:52Z [10,377ms] [Warning] [omni.fabric.plugin] USD->Fabric: Unhandled array type string[]
66
+ 2026-06-05T04:43:52Z [10,378ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:transmittance_color)
67
+ 2026-06-05T04:43:52Z [10,378ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:reflection_roughness_constant)
68
+ 2026-06-05T04:43:52Z [10,378ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:ior_constant)
69
+ 2026-06-05T04:43:52Z [11,212ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:ior_constant)
70
+ 2026-06-05T04:43:52Z [11,212ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:transmittance_color)
71
+ 2026-06-05T04:43:52Z [11,212ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:reflection_roughness_constant)
72
+ [INFO]: Time taken for simulation start : 1.411290 seconds
73
+ [INFO] Command Manager: <CommandManager> contains 0 active terms.
74
+ +------------------------+
75
+ | Active Command Terms |
76
+ +--------+-------+-------+
77
+ | Index | Name | Type |
78
+ +--------+-------+-------+
79
+ +--------+-------+-------+
80
+
81
+ [INFO] Event Manager: <EventManager> contains 1 active terms.
82
+ +---------------------------------+
83
+ | Active Event Terms in Mode: 'reset' |
84
+ +------------+--------------------+
85
+ | Index | Name |
86
+ +------------+--------------------+
87
+ | 0 | reset_all |
88
+ +------------+--------------------+
89
+
90
+ [INFO] Recorder Manager: <RecorderManager> contains 0 active terms.
91
+ +---------------------+
92
+ | Active Recorder Terms |
93
+ +-----------+---------+
94
+ | Index | Name |
95
+ +-----------+---------+
96
+ +-----------+---------+
97
+
98
+ [INFO] Action Manager: <ActionManager> contains 2 active terms.
99
+ +------------------------------------+
100
+ | Active Action Terms (shape: 8) |
101
+ +-------+----------------+-----------+
102
+ | Index | Name | Dimension |
103
+ +-------+----------------+-----------+
104
+ | 0 | arm_action | 7 |
105
+ | 1 | gripper_action | 1 |
106
+ +-------+----------------+-----------+
107
+
108
+ [INFO] Observation Manager: <ObservationManager> contains 1 groups.
109
+ +-----------------------------------------------+
110
+ | Active Observation Terms in Group: 'policy' |
111
+ +--------+--------------------+-----------------+
112
+ | Index | Name | Shape |
113
+ +--------+--------------------+-----------------+
114
+ | 0 | joint_pos | (9,) |
115
+ | 1 | joint_vel | (9,) |
116
+ | 2 | joint_pos_rel | (9,) |
117
+ | 3 | joint_vel_rel | (9,) |
118
+ | 4 | actions | (8,) |
119
+ | 5 | wrist | (480, 640, 3) |
120
+ | 6 | front | (480, 640, 3) |
121
+ | 7 | joint_pos_target | (9,) |
122
+ +--------+--------------------+-----------------+
123
+
124
+ [INFO] Termination Manager: <TerminationManager> contains 2 active terms.
125
+ +-----------------------------+
126
+ | Active Termination Terms |
127
+ +-------+----------+----------+
128
+ | Index | Name | Time Out |
129
+ +-------+----------+----------+
130
+ | 0 | time_out | True |
131
+ | 1 | success | False |
132
+ +-------+----------+----------+
133
+
134
+ [INFO] Reward Manager: <RewardManager> contains 0 active terms.
135
+ +-----------------------+
136
+ | Active Reward Terms |
137
+ +-------+------+--------+
138
+ | Index | Name | Weight |
139
+ +-------+------+--------+
140
+ +-------+------+--------+
141
+
142
+ [INFO] Curriculum Manager: <CurriculumManager> contains 0 active terms.
143
+ +----------------------+
144
+ | Active Curriculum Terms |
145
+ +-----------+----------+
146
+ | Index | Name |
147
+ +-----------+----------+
148
+ +-----------+----------+
149
+
150
+ Creating window for environment.
151
+ [INFO]: Completed setting up the environment...
152
+ [rollout] warming up renderer (20 app updates)...
153
+ [rollout] resetting environment...
154
+ [rollout] env.reset() returned
155
+ [rollout] applying object pose episode 1/100
156
+ [eval pose] bowl: pos=(0.175, -0.461, 0.050)
157
+ [eval pose] spoon: pos=(0.117, -0.239, 0.050)
158
+ [rollout] camera_infos = {'wrist': (480, 640), 'front': (480, 640)}; loading policy...
159
+ Loading local LeRobot policy 'act' from outputs/train/act_dining_cleanup_v1_9_20260604_010924/checkpoints/200000/pretrained_model...
160
+ Loading weights from local directory
161
+ Local LeRobot policy is ready.
162
+ 2026-06-05T04:43:53Z [12,254ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:reflection_roughness_constant)
163
+ 2026-06-05T04:43:53Z [12,254ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:reflection_roughness_constant)
164
+ 2026-06-05T04:43:53Z [12,254ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:ior_constant)
165
+ 2026-06-05T04:43:53Z [12,254ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:ior_constant)
166
+ 2026-06-05T04:43:53Z [12,254ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:transmittance_color)
167
+ 2026-06-05T04:43:53Z [12,254ms] [Warning] [usdrt.population.plugin] [UsdNoticeHandler] Unhandled attribute type VtArray<std::string> (prim attribute: omni:rtx:material:db:flattener:transmittance_color)
168
+ Viewports docked: [Viewport (Persp)] | [Viewport 2 (Camera)]
169
+ [video] recording rollout videos to outputs/rollout/dining_act_v1_9_200k_eval100_videos from cameras=['wrist', 'front'] at 10 fps
170
+ [Evaluation] Evaluating episode 1...
171
+ 2026-06-05T04:43:54Z [13,095ms] [Warning] [carb] Client gpu.foundation.plugin has acquired [gpu::unstable::IMemoryBudgetManagerFactory v0.1] 100 times. Consider accessing this interface with carb::getCachedInterface() (Performance warning)
172
+ [Evaluation] Episode 1 timed out!
173
+ [Evaluation] Episode 1 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=fail (coverage=fail, coverage_ratio=0.000, threshold=0.687, ideal=0.982, required=70%), protected=fail (tissue=success, vase=fail), overall=fail
174
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_01_failed.mp4 (800 frames)
175
+ [rollout] resetting environment...
176
+ [rollout] env.reset() returned
177
+ [rollout] applying object pose episode 2/100
178
+ [eval pose] spoon: pos=(0.149, -0.238, 0.050)
179
+ [eval pose] bowl: pos=(0.151, -0.474, 0.050)
180
+ [Evaluation] now success rate: 0.0 [0/1]
181
+ [Evaluation] Evaluating episode 2...
182
+ [Evaluation] Episode 2 timed out!
183
+ [Evaluation] Episode 2 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=fail (coverage=fail, coverage_ratio=0.000, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=fail
184
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_02_failed.mp4 (800 frames)
185
+ [rollout] resetting environment...
186
+ [rollout] env.reset() returned
187
+ [rollout] applying object pose episode 3/100
188
+ [eval pose] spoon: pos=(0.117, -0.266, 0.050)
189
+ [eval pose] bowl: pos=(0.177, -0.497, 0.050)
190
+ [Evaluation] now success rate: 0.0 [0/2]
191
+ [Evaluation] Evaluating episode 3...
192
+ [Evaluation] Episode 3 timed out!
193
+ [Evaluation] Episode 3 stage status: tableware=fail (bowl_xy=fail, spoon_xy=fail), wiping=fail (coverage=fail, coverage_ratio=0.000, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=fail
194
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_03_failed.mp4 (800 frames)
195
+ [rollout] resetting environment...
196
+ [rollout] env.reset() returned
197
+ [rollout] applying object pose episode 4/100
198
+ [eval pose] bowl: pos=(0.122, -0.494, 0.050)
199
+ [eval pose] spoon: pos=(0.112, -0.228, 0.050)
200
+ [Evaluation] now success rate: 0.0 [0/3]
201
+ [Evaluation] Evaluating episode 4...
202
+ [Evaluation] Episode 4 is successful!
203
+ [Evaluation] Episode 4 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=success (coverage=success, coverage_ratio=0.688, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=success
204
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_04_success.mp4 (778 frames)
205
+ [rollout] resetting environment...
206
+ [rollout] env.reset() returned
207
+ [rollout] applying object pose episode 5/100
208
+ [eval pose] bowl: pos=(0.147, -0.232, 0.050)
209
+ [eval pose] spoon: pos=(0.146, -0.494, 0.050)
210
+ [Evaluation] now success rate: 0.25 [1/4]
211
+ [Evaluation] Evaluating episode 5...
212
+ [Evaluation] Episode 5 is successful!
213
+ [Evaluation] Episode 5 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=success (coverage=success, coverage_ratio=0.690, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=success
214
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_05_success.mp4 (795 frames)
215
+ [rollout] resetting environment...
216
+ [rollout] env.reset() returned
217
+ [rollout] applying object pose episode 6/100
218
+ [eval pose] bowl: pos=(0.169, -0.253, 0.050)
219
+ [eval pose] spoon: pos=(0.131, -0.470, 0.050)
220
+ [Evaluation] now success rate: 0.4 [2/5]
221
+ [Evaluation] Evaluating episode 6...
222
+ [Evaluation] Episode 6 timed out!
223
+ [Evaluation] Episode 6 stage status: tableware=fail (bowl_xy=fail, spoon_xy=fail), wiping=fail (coverage=fail, coverage_ratio=0.000, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=fail
224
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_06_failed.mp4 (800 frames)
225
+ [rollout] resetting environment...
226
+ [rollout] env.reset() returned
227
+ [rollout] applying object pose episode 7/100
228
+ [eval pose] bowl: pos=(0.125, -0.222, 0.050)
229
+ [eval pose] spoon: pos=(0.155, -0.492, 0.050)
230
+ [Evaluation] now success rate: 0.3333333333333333 [2/6]
231
+ [Evaluation] Evaluating episode 7...
232
+ [Evaluation] Episode 7 is successful!
233
+ [Evaluation] Episode 7 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=success (coverage=success, coverage_ratio=0.688, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=success
234
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_07_success.mp4 (573 frames)
235
+ [rollout] resetting environment...
236
+ [rollout] env.reset() returned
237
+ [rollout] applying object pose episode 8/100
238
+ [eval pose] spoon: pos=(0.158, -0.240, 0.050)
239
+ [eval pose] bowl: pos=(0.103, -0.457, 0.050)
240
+ [Evaluation] now success rate: 0.42857142857142855 [3/7]
241
+ [Evaluation] Evaluating episode 8...
242
+ [Evaluation] Episode 8 timed out!
243
+ [Evaluation] Episode 8 stage status: tableware=fail (bowl_xy=fail, spoon_xy=fail), wiping=fail (coverage=fail, coverage_ratio=0.000, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=fail
244
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_08_failed.mp4 (800 frames)
245
+ [rollout] resetting environment...
246
+ [rollout] env.reset() returned
247
+ [rollout] applying object pose episode 9/100
248
+ [eval pose] bowl: pos=(0.122, -0.238, 0.050)
249
+ [eval pose] spoon: pos=(0.144, -0.477, 0.050)
250
+ [Evaluation] now success rate: 0.375 [3/8]
251
+ [Evaluation] Evaluating episode 9...
252
+ [Evaluation] Episode 9 is successful!
253
+ [Evaluation] Episode 9 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=success (coverage=success, coverage_ratio=0.693, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=success
254
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_09_success.mp4 (551 frames)
255
+ [rollout] resetting environment...
256
+ [rollout] env.reset() returned
257
+ [rollout] applying object pose episode 10/100
258
+ [eval pose] bowl: pos=(0.107, -0.263, 0.050)
259
+ [eval pose] spoon: pos=(0.148, -0.487, 0.050)
260
+ [Evaluation] now success rate: 0.4444444444444444 [4/9]
261
+ [Evaluation] Evaluating episode 10...
262
+ [Evaluation] Episode 10 is successful!
263
+ [Evaluation] Episode 10 stage status: tableware=success (bowl_xy=success, spoon_xy=success), wiping=success (coverage=success, coverage_ratio=0.690, threshold=0.687, ideal=0.982, required=70%), protected=success (tissue=success, vase=success), overall=success
264
+ [video] saved outputs/rollout/dining_act_v1_9_200k_eval100_videos/ep_10_success.mp4 (552 frames)
265
+ [Evaluation] now success rate: 0.5 [5/10]
266
+ [Evaluation] Final success rate: 0.500 [5/10]