struggling during inference

#4
by nikita200 - opened

No policy or teleoperator provided, skipping action generation.This is likely to happen when resetting the environment without a teleop device.The robot won't be at its rest position at the start of the next episode.

additional logs
2025-11-28T08:30:24Z INFO re_grpc_server] Listening for gRPC connections on 0.0.0.0:9876. Connect by running rerun --connect rerun+http://127.0.0.1:9876/proxy
[2025-11-28T08:30:24Z INFO winit::platform_impl::linux::x11::window] Guessed window scale factor: 1
[2025-11-28T08:30:24Z WARN wgpu_hal::vulkan::instance] Unable to find extension: VK_EXT_physical_device_drm
[2025-11-28T08:30:24Z WARN wgpu_hal::gles::egl] No config found!
[2025-11-28T08:30:24Z WARN wgpu_hal::gles::egl] EGL says it can present to the window but not natively
[2025-11-28T08:30:24Z WARN wgpu_hal::gles::adapter] Max vertex attribute stride unknown. Assuming it is 2048
[2025-11-28T08:30:24Z WARN wgpu_hal::gles::adapter] Max vertex attribute stride unknown. Assuming it is 2048
[2025-11-28T08:30:24Z INFO egui_wgpu] There were 3 available wgpu adapters: {backend: Vulkan, device_type: DiscreteGpu, name: "NVIDIA GeForce RTX 3080", driver: "NVIDIA", driver_info: "570.86.10", vendor: NVIDIA (0x10DE), device: 0x220A}, {backend: Vulkan, device_type: Cpu, name: "llvmpipe (LLVM 15.0.7, 256 bits)", driver: "llvmpipe", driver_info: "Mesa 23.2.1-1ubuntu3.1~22.04.3 (LLVM 15.0.7)", vendor: Mesa (0x10005)}, {backend: Gl, device_type: Other, name: "NVIDIA GeForce RTX 3080/PCIe/SSE2", driver_info: "3.3.0 NVIDIA 570.86.10", vendor: NVIDIA (0x10DE)}
INFO 2025-11-28 14:00:27 a_opencv.py:180 OpenCVCamera(/dev/video1) connected.
INFO 2025-11-28 14:00:28 a_opencv.py:180 OpenCVCamera(/dev/video0) connected.
INFO 2025-11-28 14:00:28 follower.py:104 my_robot SO100Follower connected.
INFO 2025-11-28 14:00:28 ls/utils.py:227 Recording episode 0
INFO 2025-11-28 14:01:28 ls/utils.py:227 Reset the environment

command I am using for inference

lerobot-record --robot.type=so100_follower --robot.port=/dev/ttyACM0 --robot.id=my_robot --robot.cameras="{ main: {type: opencv, index_or_path: /dev/video1, width: 640, height: 480, fps: 30}, secondary_0: {type: opencv, index_or_path: /dev/video0, width: 640, height: 480, fps: 30}}" --display_data=true --dataset.repo_id=hf_user/eval_roboarm_dataset_5_v8 --dataset.num_episodes=10 --dataset.single_task="purple ball" --policy.path=hf_user/roboarm_act_model

the so100 arm is not moving. what should I do?

Sign up or log in to comment