[confirm-ep0950] 2026-06-10T09:54:49Z CKPT=ep-0950_sr-0.527 n_test_per_task=50 num_exp=3 n_parallel_envs=4 device=cuda:0 /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead. warnings.warn( /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`. warnings.warn(msg) oatpolicy_dense|rgb initialized (dense_visual_memory) with obs enc: 22.4M (100.00000% trainable) act tok: 5.8M (0.00000% trainable) policy : 5.3M (100.00000% trainable) Traceback (most recent call last): File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/scripts/eval_policy_sim.py", line 271, in eval_policy_sim() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1524, in __call__ return self.main(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1445, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1308, in invoke return ctx.invoke(self.callback, **ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 877, in invoke return callback(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/scripts/eval_policy_sim.py", line 171, in eval_policy_sim policy.to(device_t) File "/opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1174, in to return self._apply(convert) ^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) [Previous line repeated 5 more times] File "/opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py", line 805, in _apply param_applied = fn(param) ^^^^^^^^^ File "/opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1160, in convert return t.to( ^^^^^ File "/opt/conda/lib/python3.11/site-packages/torch/cuda/__init__.py", line 314, in _lazy_init torch._C._cuda_init() RuntimeError: No CUDA GPUs are available [confirm-ep0950] 2026-06-10T09:57:16Z CKPT=ep-0950_sr-0.527 n_test_per_task=50 num_exp=3 n_parallel_envs=4 device=cuda:0 /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead. warnings.warn( /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`. warnings.warn(msg) oatpolicy_dense|rgb initialized (dense_visual_memory) with obs enc: 22.4M (100.00000% trainable) act tok: 5.8M (0.00000% trainable) policy : 5.3M (100.00000% trainable) Running evaluation on /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/output/long/oat_dense_with_uid_long_0530_220204/checkpoints/ep-0950_sr-0.527.ckpt task_suite=libero10 num_tasks=10 n_test=500 (~50.0 episodes/task) test_start_seed=1000 num_exp=3 seed_stride=500 exp 1/3: test_start_seed=1000 [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information.Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Process Worker-2: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_kitchen_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-3: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_kitchen_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-1: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_living_room_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-0: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_living_room_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 92, in _call_target return _target_(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 179, in __init__ env = AsyncVectorEnv( ^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 168, in __init__ self._check_spaces() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 632, in _check_spaces pipe.send(("_check_spaces", spaces)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 421, in _send_bytes self._send(buf) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 384, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/scripts/eval_policy_sim.py", line 271, in eval_policy_sim() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1524, in __call__ return self.main(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1445, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1308, in invoke return ctx.invoke(self.callback, **ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 877, in invoke return callback(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/scripts/eval_policy_sim.py", line 215, in eval_policy_sim env_runner: BaseRunner = hydra.utils.instantiate( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 226, in instantiate return instantiate_node( ^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 347, in instantiate_node return _call_target(_target_, partial, args, kwargs, full_key) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 97, in _call_target raise InstantiationException(msg) from e hydra.errors.InstantiationException: Error in call to target 'oat.env_runner.libero_runner.LiberoRunner': BrokenPipeError(32, 'Broken pipe') full_key: task.policy.env_runner sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. [confirm-ep0950] 2026-06-10T09:58:32Z CKPT=ep-0950_sr-0.527 n_test_per_task=50 num_exp=3 n_parallel_envs=4 device=cuda:0 /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead. warnings.warn( /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`. warnings.warn(msg) oatpolicy_dense|rgb initialized (dense_visual_memory) with obs enc: 22.4M (100.00000% trainable) act tok: 5.8M (0.00000% trainable) policy : 5.3M (100.00000% trainable) Running evaluation on /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/output/long/oat_dense_with_uid_long_0530_220204/checkpoints/ep-0950_sr-0.527.ckpt task_suite=libero10 num_tasks=10 n_test=500 (~50.0 episodes/task) test_start_seed=1000 num_exp=3 seed_stride=500 exp 1/3: test_start_seed=1000 [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Process Worker-2: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_kitchen_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-3: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_kitchen_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-0: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_living_room_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-1: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 690, in _async_worker env = env_fn() ^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/gymnasium/vector/utils/misc.py", line 35, in __call__ return self.fn() ^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 92, in env_fn LiberoEnv( File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env/libero/env.py", line 47, in __init__ env = ControlEnv( ^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/env_wrapper.py", line 56, in __init__ self.env = TASK_MAPPING[self.problem_name]( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/problems/libero_living_room_tabletop_manipulation.py", line 42, in __init__ super().__init__(bddl_file_name, *args, **kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 135, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/manipulation/manipulation_env.py", line 162, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 214, in __init__ super().__init__( File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 143, in __init__ self._reset_internal() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/envs/bddl_base_domain.py", line 735, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/robot_env.py", line 510, in _reset_internal super()._reset_internal() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/environments/base.py", line 296, in _reset_internal render_context = MjRenderContextOffscreen(self.sim, device_id=self.render_gpu_device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 210, in __init__ super().__init__(sim, offscreen=True, device_id=device_id, max_width=max_width, max_height=max_height) File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 78, in __init__ self.gl_ctx = GLContext(max_width=max_width, max_height=max_height, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 121, in __init__ EGL_DISPLAY = create_initialized_egl_device_display(device_id=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 61, in create_initialized_egl_device_display raise RuntimeError( RuntimeError: The MUJOCO_EGL_DEVICE_ID environment variable must be an integer between 0 and 0 (inclusive), got 1. Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 155, in __del__ self.free() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/renderers/context/egl_context.py", line 146, in free if self._context: ^^^^^^^^^^^^^ AttributeError: 'EGLGLContext' object has no attribute '_context' Exception ignored in: Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/utils/binding_utils.py", line 198, in __del__ self.con.free() ^^^^^^^^ AttributeError: 'MjRenderContextOffscreen' object has no attribute 'con' sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Traceback (most recent call last): File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 92, in _call_target return _target_(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/env_runner/libero_runner.py", line 179, in __init__ env = AsyncVectorEnv( ^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 168, in __init__ self._check_spaces() File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 632, in _check_spaces pipe.send(("_check_spaces", spaces)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 421, in _send_bytes self._send(buf) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 384, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/scripts/eval_policy_sim.py", line 275, in eval_policy_sim() File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1524, in __call__ return self.main(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1445, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 1308, in invoke return ctx.invoke(self.callback, **ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/click/core.py", line 877, in invoke return callback(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/scripts/eval_policy_sim.py", line 217, in eval_policy_sim env_runner: BaseRunner = hydra.utils.instantiate( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 226, in instantiate return instantiate_node( ^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 347, in instantiate_node return _call_target(_target_, partial, args, kwargs, full_key) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/askhabaliev_gs/.local/lib/python3.11/site-packages/hydra/_internal/instantiate/_instantiate2.py", line 97, in _call_target raise InstantiationException(msg) from e hydra.errors.InstantiationException: Error in call to target 'oat.env_runner.libero_runner.LiberoRunner': BrokenPipeError(32, 'Broken pipe') full_key: task.policy.env_runner sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. [confirm-ep0950] 2026-06-10T10:00:24Z CKPT=ep-0950_sr-0.527 n_test_per_task=50 num_exp=3 n_parallel_envs=4 device=cuda:0 /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead. warnings.warn( /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`. warnings.warn(msg) oatpolicy_dense|rgb initialized (dense_visual_memory) with obs enc: 22.4M (100.00000% trainable) act tok: 5.8M (0.00000% trainable) policy : 5.3M (100.00000% trainable) Running evaluation on /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/output/long/oat_dense_with_uid_long_0530_220204/checkpoints/ep-0950_sr-0.527.ckpt task_suite=libero10 num_tasks=10 n_test=500 (~50.0 episodes/task) test_start_seed=1000 num_exp=3 seed_stride=500 exp 1/3: test_start_seed=1000 [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Eval oatpolicy_dense|rgb in Libero::libero10 1/125: 0%| | 0/550 [00:00-2: Traceback (most recent call last): Process Worker-3: File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 699, in _async_worker command, data = pipe.recv() ^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 250, in recv buf = self._recv_bytes() ^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 430, in _recv_bytes buf = self._recv(4) ^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 395, in _recv chunk = read(handle, remaining) ^^^^^^^^^^^^^^^^^^^^^^^ ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 763, in _async_worker pipe.send((None, False)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 427, in _send_bytes self._send(header + buf) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 384, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe Traceback (most recent call last): File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 699, in _async_worker command, data = pipe.recv() ^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 250, in recv buf = self._recv_bytes() ^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 430, in _recv_bytes buf = self._recv(4) ^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 395, in _recv chunk = read(handle, remaining) ^^^^^^^^^^^^^^^^^^^^^^^ ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 763, in _async_worker pipe.send((None, False)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 427, in _send_bytes self._send(header + buf) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 384, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-1: Traceback (most recent call last): File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 699, in _async_worker command, data = pipe.recv() ^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 250, in recv buf = self._recv_bytes() ^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 430, in _recv_bytes buf = self._recv(4) ^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 399, in _recv raise EOFError EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 763, in _async_worker pipe.send((None, False)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 427, in _send_bytes self._send(header + buf) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 384, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. Process Worker-0: Traceback (most recent call last): File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 699, in _async_worker command, data = pipe.recv() ^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 250, in recv buf = self._recv_bytes() ^^^^^^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 430, in _recv_bytes buf = self._recv(4) ^^^^^^^^^^^^^ File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 399, in _recv raise EOFError EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/opt/conda/lib/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/oat/gymnasium_util/async_vector_env.py", line 763, in _async_worker pipe.send((None, False)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj)) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 427, in _send_bytes self._send(header + buf) File "/opt/conda/lib/python3.11/multiprocessing/connection.py", line 384, in _send n = write(self._handle, buf) ^^^^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipe sys:1: DeprecationWarning: Call to deprecated function (or staticmethod) _destroy. /opt/conda/lib/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d ' /opt/conda/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/mp-y6iyt8vu': [Errno 2] No such file or directory warnings.warn('resource_tracker: %r: %s' % (name, e)) /opt/conda/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/mp-brec6i71': [Errno 2] No such file or directory warnings.warn('resource_tracker: %r: %s' % (name, e)) /opt/conda/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/mp-uotrx0ta': [Errno 2] No such file or directory warnings.warn('resource_tracker: %r: %s' % (name, e)) [confirm-ep0950] 2026-06-12T13:10:17Z CKPT=ep-0950_sr-0.527 n_test_per_task=50 num_exp=3 n_parallel_envs=4 device=cuda:0 /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead. warnings.warn( /opt/conda/lib/python3.11/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`. warnings.warn(msg) oatpolicy_dense|rgb initialized (dense_visual_memory) with obs enc: 22.4M (100.00000% trainable) act tok: 5.8M (0.00000% trainable) policy : 5.3M (100.00000% trainable) Running evaluation on /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/output/long/oat_dense_with_uid_long_0530_220204/checkpoints/ep-0950_sr-0.527.ckpt task_suite=libero10 num_tasks=10 n_test=500 (~50.0 episodes/task) test_start_seed=1000 num_exp=3 seed_stride=500 exp 1/3: test_start_seed=1000 [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) [robosuite WARNING] No private macro file found! (__init__.py:7) [robosuite WARNING] It is recommended to use a private macro file (__init__.py:8) [robosuite WARNING] To setup, run: python /home/askhabaliev_gs/.local/lib/python3.11/site-packages/robosuite/scripts/setup_macros.py (__init__.py:9) Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality. Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade. See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information. [info] using task orders [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] [Warning]: datasets path /workspace/OAT-RoboMimic-Fine-tune/BLT-OAT/third_party/LIBERO/libero/libero/../datasets does not exist! Eval oatpolicy_dense|rgb in Libero::libero10 1/125: 0%| | 0/550 [00:00