shraavb commited on
Commit
f0a656b
·
verified ·
1 Parent(s): 4aa4a18

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +55 -38
README.md CHANGED
@@ -1,62 +1,79 @@
1
  ---
2
- datasets: shraavb/pick_place_cube
3
- library_name: lerobot
4
  license: apache-2.0
5
- model_name: act
6
- pipeline_tag: robotics
7
  tags:
8
- - lerobot
9
  - robotics
 
10
  - act
 
 
 
11
  ---
12
 
13
- # Model Card for act
14
-
15
- <!-- Provide a quick summary of what the model is/does. -->
16
-
17
 
18
- [Action Chunking with Transformers (ACT)](https://huggingface.co/papers/2304.13705) is an imitation-learning method that predicts short action chunks instead of single steps. It learns from teleoperated data and often achieves high success rates.
19
 
 
20
 
21
- This policy has been trained and pushed to the Hub using [LeRobot](https://github.com/huggingface/lerobot).
22
- See the full documentation at [LeRobot Docs](https://huggingface.co/docs/lerobot/index).
23
-
24
- ---
25
-
26
- ## How to Get Started with the Model
27
 
28
- For a complete walkthrough, see the [training guide](https://huggingface.co/docs/lerobot/il_robots#train-a-policy).
29
- Below is the short version on how to train and run inference/eval:
 
 
 
 
30
 
31
- ### Train from scratch
32
 
33
- ```bash
34
- lerobot-train \
35
- --dataset.repo_id=${HF_USER}/<dataset> \
36
- --policy.type=act \
37
- --output_dir=outputs/train/<desired_policy_repo_id> \
38
- --job_name=lerobot_training \
39
- --policy.device=cuda \
40
- --policy.repo_id=${HF_USER}/<desired_policy_repo_id>
41
- --wandb.enable=true
 
 
 
 
 
 
 
 
 
 
 
42
  ```
43
 
44
- _Writes checkpoints to `outputs/train/<desired_policy_repo_id>/checkpoints/`._
45
 
46
- ### Evaluate the policy/run inference
47
 
48
  ```bash
49
  lerobot-record \
50
- --robot.type=so100_follower \
51
- --dataset.repo_id=<hf_user>/eval_<dataset> \
52
- --policy.path=<hf_user>/<desired_policy_repo_id> \
53
- --episodes=10
 
 
54
  ```
55
 
56
- Prefix the dataset repo with **eval\_** and supply `--policy.path` pointing to a local or hub checkpoint.
57
 
58
- ---
 
 
59
 
60
- ## Model Details
 
 
 
 
 
 
61
 
62
- - **License:** apache-2.0
 
1
  ---
 
 
2
  license: apache-2.0
 
 
3
  tags:
 
4
  - robotics
5
+ - lerobot
6
  - act
7
+ - imitation-learning
8
+ - so101
9
+ - manipulation
10
  ---
11
 
12
+ # ACT Policy for Pick and Place Cube Task
 
 
 
13
 
14
+ This model was trained using [LeRobot](https://github.com/huggingface/lerobot) to perform a pick-and-place task with an SO-101 robot arm.
15
 
16
+ ## Task Description
17
 
18
+ **Task:** Pick up a cube and place it in a container
 
 
 
 
 
19
 
20
+ The robot learns to:
21
+ 1. Locate the cube visually
22
+ 2. Move the gripper to the cube
23
+ 3. Grasp the cube
24
+ 4. Transport it to the target container
25
+ 5. Release the cube into the container
26
 
27
+ ## Model Details
28
 
29
+ - **Policy Type:** ACT (Action Chunking with Transformers)
30
+ - **Robot:** SO-101 Follower Arm (6-DOF with gripper)
31
+ - **Camera:** Single front-facing RGB camera (640x480 @ 30fps)
32
+ - **Training Steps:** 100,000
33
+ - **Training Episodes:** 51 demonstrations
34
+ - **Framework:** LeRobot
35
+
36
+ ## Training Configuration
37
+
38
+ ```yaml
39
+ policy:
40
+ type: act
41
+ chunk_size: 100
42
+ n_action_steps: 100
43
+ dim_model: 512
44
+ n_heads: 8
45
+ n_encoder_layers: 4
46
+ n_decoder_layers: 1
47
+ vision_backbone: resnet18
48
+ use_vae: true
49
  ```
50
 
51
+ ## Usage
52
 
53
+ ### Evaluation on Robot
54
 
55
  ```bash
56
  lerobot-record \
57
+ --robot.type=so101_follower \
58
+ --robot.port=/dev/ttyACM0 \
59
+ --robot.cameras='{ front: {type: opencv, index_or_path: 0, width: 640, height: 480, fps: 30} }' \
60
+ --dataset.repo_id=YOUR_USERNAME/eval_pick_place_cube \
61
+ --dataset.single_task="Pick up the cube and place it in the container" \
62
+ --policy.path=shraavb/act_pick_place_cube
63
  ```
64
 
65
+ ## Training Dataset
66
 
67
+ - **Dataset:** [shraavb/pick_place_cube](https://huggingface.co/datasets/shraavb/pick_place_cube)
68
+ - **Episodes:** 51
69
+ - **Frames:** ~45,000
70
 
71
+ ## Hardware Requirements
72
+
73
+ - SO-101 robot arm with Feetech STS3215 servos
74
+ - USB camera (webcam or similar)
75
+ - Computer with USB ports for robot and camera
76
+
77
+ ## Acknowledgments
78
 
79
+ Trained following the [Seeed Studio LeRobot tutorial](https://wiki.seeedstudio.com/lerobot_so100m/).