ManiGuard: Benchmark & Datasets

IDEAS-Lab-Northwestern 's Collections

ManiGuard: Evaluated VLA Checkpoints

updated Aug 20

ManiGuard-Bench tasks, the long-finger Franka asset, and the 6-family SFT demo trajectories (LeRobot v2.1).

Upvote

IDEAS-Lab-Northwestern/ManiGuard-Bench

Viewer • Updated 17 days ago • 5k • 45.5k • 2

Note The frozen evaluation benchmark: 200 base tasks × 5 levels (ID + 4 OOD), 6 families
IDEAS-Lab-Northwestern/franka-panda-longfinger

Updated Sep 23 • 303

Note Long-finger Franka Panda robot asset (required by every sim run)
IDEAS-Lab-Northwestern/maniguard-grasp-annotations

Updated Aug 20 • 54
IDEAS-Lab-Northwestern/datagen-clutter-v1-joint-5cam

Franka Panda • Updated Aug 20 • 2.2k episodes • 369

Note SFT demonstrations · clutter · 40 success+safe episodes/task · LeRobot v2.1, 5-cam
IDEAS-Lab-Northwestern/datagen-cabinet-v1-joint-5cam

Franka Panda • Updated Aug 20 • 1.4k episodes • 528

Note SFT demonstrations · cabinet · 40 success+safe episodes/task · LeRobot v2.1, 5-cam
IDEAS-Lab-Northwestern/datagen-stack-v1-joint-5cam

Franka Panda • Updated Aug 20 • 1.12k episodes • 1.04k

Note SFT demonstrations · stack · 40 success+safe episodes/task · LeRobot v2.1, 5-cam
IDEAS-Lab-Northwestern/datagen-jar-v1-joint-5cam

Franka Panda • Updated Aug 20 • 1.04k episodes • 610

Note SFT demonstrations · jar · 40 success+safe episodes/task · LeRobot v2.1, 5-cam
IDEAS-Lab-Northwestern/datagen-lid-v1-joint-5cam

Franka Panda • Updated Aug 20 • 1.2k episodes • 369

Note SFT demonstrations · lid · 40 success+safe episodes/task · LeRobot v2.1, 5-cam
IDEAS-Lab-Northwestern/datagen-dusty-v1-joint-5cam

Franka Panda • Updated Aug 20 • 1.04k episodes • 467

Note SFT demonstrations · dusty · 40 success+safe episodes/task · LeRobot v2.1, 5-cam

Upvote