Robotics
LeRobot
pi0
vla
imitation-learning
so101
abdul004 commited on
Commit
91019df
·
verified ·
1 Parent(s): ccc62c8

Remove internal episode wording from journey doc

Browse files
pi0_so101/MULTITASK_INFERENCE_AND_COMPRESSION_JOURNEY.md CHANGED
@@ -38,9 +38,9 @@ Representative demo artifacts:
38
  - Whistle to green bin: `eval_pi05_multitask_whistle_green/eval_demo.gif`
39
  - Lego/block to yellow-blue target: `eval_pi05_multitask_lego_yellow_bluen/eval_demo.gif`
40
 
41
- Representative successful whistle/green-bin rollout from episode 10 direct inference:
42
 
43
- ![Direct Pi0.5 whistle to green bin](../traces/trace_pi05_direct_whistle_green_bin_runpod_live_12_1200_from_ep10_start/eval_demo_once.gif)
44
 
45
  ## 2. Direct Remote Inference
46
 
@@ -59,7 +59,7 @@ uv run scripts/serve_policy.py --port 8000 \
59
  --policy.dir=/workspace/checkpoint/4999
60
  ```
61
 
62
- On the Mac, `experiments/policy_trace/record.py` records a full closed-loop trace while controlling the robot. For a clean run, we first move the robot to a known start pose:
63
 
64
  ```bash
65
  PYTHONPATH=. python experiments/policy_trace/move_to_start_pose.py \
@@ -85,7 +85,7 @@ PYTHONPATH=. python experiments/policy_trace/record.py \
85
  --max-relative-target 15 \
86
  --jpeg-quality 80 \
87
  --frame-quality 92 \
88
- --start-pose "trace_pi05_whistle_to_bin_runpod_10_start"
89
  ```
90
 
91
  This answered the first practical question:
@@ -163,9 +163,9 @@ This stage did produce useful robot behavior. The important lesson was more spec
163
  - jerk amplification,
164
  - and eventually real robot rollouts.
165
 
166
- The decoder-only episode 10 replay is a good example: it showed the idea could work, but it also exposed the high-jerk behavior that made action-level evaluation necessary.
167
 
168
- ![Decoder-only episode 10 replay with high jerk](../experiments/trace_compression/runs/whistle10_ld64_smooth_320x240/predicted_action_trace/action_replays/trace_pi05_robot_replay_01/eval_demo.gif)
169
 
170
  ## 5. Real Encoder-Decoder: Global Latents
171
 
@@ -281,7 +281,7 @@ Visual inspection matched this:
281
  - bin edges and small object/gripper structure were softened,
282
  - and the policy likely lost important spatial cues.
283
 
284
- The comparison below shows local camera frames against the server-decoded latent frames from the live latent episode 10 run:
285
 
286
  ![Local frames vs server-decoded latent frames](docs_assets/latent10_local_vs_server_decoded.gif)
287
 
 
38
  - Whistle to green bin: `eval_pi05_multitask_whistle_green/eval_demo.gif`
39
  - Lego/block to yellow-blue target: `eval_pi05_multitask_lego_yellow_bluen/eval_demo.gif`
40
 
41
+ Representative successful whistle/green-bin rollout from live direct inference:
42
 
43
+ ![Direct Pi0.5 whistle to green bin](docs_assets/direct_whistle_green_bin_rollout.gif)
44
 
45
  ## 2. Direct Remote Inference
46
 
 
59
  --policy.dir=/workspace/checkpoint/4999
60
  ```
61
 
62
+ On the Mac, `experiments/policy_trace/record.py` records a full closed-loop trace while controlling the robot. For a clean run, we first move the robot to a fixed start pose:
63
 
64
  ```bash
65
  PYTHONPATH=. python experiments/policy_trace/move_to_start_pose.py \
 
85
  --max-relative-target 15 \
86
  --jpeg-quality 80 \
87
  --frame-quality 92 \
88
+ --start-pose "saved_start_pose"
89
  ```
90
 
91
  This answered the first practical question:
 
163
  - jerk amplification,
164
  - and eventually real robot rollouts.
165
 
166
+ The decoder-only robot replay is a good example: it showed the idea could work, but it also exposed the high-jerk behavior that made action-level evaluation necessary.
167
 
168
+ ![Decoder-only robot replay with high jerk](../experiments/trace_compression/runs/whistle10_ld64_smooth_320x240/predicted_action_trace/action_replays/trace_pi05_robot_replay_01/eval_demo.gif)
169
 
170
  ## 5. Real Encoder-Decoder: Global Latents
171
 
 
281
  - bin edges and small object/gripper structure were softened,
282
  - and the policy likely lost important spatial cues.
283
 
284
+ The comparison below shows local camera frames against the server-decoded latent frames from a live latent rollout:
285
 
286
  ![Local frames vs server-decoded latent frames](docs_assets/latent10_local_vs_server_decoded.gif)
287