Robotics
LeRobot
Safetensors
imitation-learning
aloha
act
LeTau commited on
Commit
ef2ae13
·
verified ·
1 Parent(s): 2b66beb

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +129 -0
README.md ADDED
@@ -0,0 +1,129 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: lerobot
4
+ tags:
5
+ - robotics
6
+ - imitation-learning
7
+ - aloha
8
+ - act
9
+ - lerobot
10
+ datasets:
11
+ - lerobot/aloha_sim_transfer_cube_human_image
12
+ pipeline_tag: robotics
13
+ ---
14
+
15
+ # ACT Model for ALOHA TransferCube Task
16
+
17
+ A lightweight Action Chunking with Transformers (ACT) model trained on the ALOHA simulation TransferCube task.
18
+
19
+ ## Model Description
20
+
21
+ | Property | Value |
22
+ |----------|-------|
23
+ | Architecture | ACT (Action Chunking with Transformers) |
24
+ | Parameters | 52M |
25
+ | Task | ALOHA TransferCube-v0 |
26
+ | Training Steps | 60,000 |
27
+ | Batch Size | 32 |
28
+ | Success Rate | ~42% |
29
+
30
+ ## Training Data
31
+
32
+ - **Dataset**: [lerobot/aloha_sim_transfer_cube_human_image](https://huggingface.co/datasets/lerobot/aloha_sim_transfer_cube_human_image)
33
+ - **Episodes**: 50 human demonstrations
34
+ - **Frames**: 20,000
35
+
36
+ ## Task Description
37
+
38
+ The TransferCube task requires a bimanual robot to:
39
+ 1. Pick up a red cube with the right arm
40
+ 2. Transfer the cube to the left gripper
41
+
42
+ ## Training Environment
43
+
44
+ - **GPU**: RTX A6000
45
+ - **Framework**: LeRobot 0.4.3
46
+
47
+ ## Usage
48
+
49
+ ### Installation
50
+ ```bash
51
+ pip install lerobot gym-aloha
52
+ ```
53
+
54
+ ### Training
55
+ ```bash
56
+ lerobot-train \
57
+ --policy.type=act \
58
+ --dataset.repo_id=lerobot/aloha_sim_transfer_cube_human_image \
59
+ --env.type=aloha \
60
+ --env.task=AlohaTransferCube-v0 \
61
+ --batch_size=32 \
62
+ --steps=60000 \
63
+ --eval_freq=5000 \
64
+ --output_dir=./outputs/act_aloha_cube_best \
65
+ --wandb.enable=false \
66
+ --policy.push_to_hub=false
67
+ ```
68
+
69
+ ### Evaluation
70
+ ```bash
71
+ lerobot-eval \
72
+ --policy.path=LeTau/act_aloha_transfer_cube \
73
+ --env.type=aloha \
74
+ --env.task=AlohaTransferCube-v0 \
75
+ --eval.batch_size=1 \
76
+ --eval.n_episodes=20
77
+ ```
78
+
79
+ ### Fine-tuning
80
+ ```bash
81
+ lerobot-train \
82
+ --resume=true \
83
+ --config_path=LeTau/act_aloha_transfer_cube/train_config.json \
84
+ --steps=100000
85
+ ```
86
+
87
+ ## Results
88
+
89
+ | Evaluation | Episodes | Success Rate | Avg Sum Reward |
90
+ |------------|----------|--------------|----------------|
91
+ | Training | 50 | 42% | 116.26 |
92
+ | Independent | 20 | 35% | 95.95 |
93
+
94
+ **Expected success rate: 35-42%**
95
+
96
+ <details>
97
+ <summary>Detailed Evaluation Results</summary>
98
+ ```
99
+ Sum Rewards: [0.0, 241.0, 57.0, 201.0, 48.0, 0.0, 0.0, 220.0, 262.0, 0.0,
100
+ 59.0, 211.0, 287.0, 187.0, 74.0, 2.0, 203.0, 18.0, 10.0, 0.0,
101
+ 0.0, 263.0, 7.0, 57.0, 39.0, 214.0, 297.0, 24.0, 0.0, 274.0,
102
+ 201.0, 2.0, 228.0, 228.0, 68.0, 290.0, 2.0, 222.0, 31.0, 219.0,
103
+ 69.0, 22.0, 0.0, 76.0, 244.0, 227.0, 0.0, 26.0, 192.0, 211.0]
104
+
105
+ Successes: 21/50 episodes
106
+ ```
107
+
108
+ </details>
109
+
110
+ ## Limitations
111
+
112
+ - **Limited training data**: Only 50 demonstration episodes available
113
+ - **Moderate success rate**: This is a lightweight baseline model
114
+ - **Single task**: Only trained on TransferCube, no multi-task capability
115
+
116
+ ## Citation
117
+ ```bibtex
118
+ @article{zhao2023learning,
119
+ title={Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware},
120
+ author={Zhao, Tony Z and Kumar, Vikash and Levine, Sergey and Finn, Chelsea},
121
+ journal={arXiv preprint arXiv:2304.13705},
122
+ year={2023}
123
+ }
124
+ ```
125
+
126
+ ## Acknowledgments
127
+
128
+ - [LeRobot](https://github.com/huggingface/lerobot) framework by HuggingFace
129
+ - [ALOHA](https://tonyzhaozh.github.io/aloha/) project by Stanford