Instructions to use wsagi/DiffusionPolicy-PickOrange with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use wsagi/DiffusionPolicy-PickOrange with LeRobot:
- Notebooks
- Google Colab
- Kaggle
Fix GPU model + add training/eval repo links
Browse files
README.md
CHANGED
|
@@ -21,6 +21,16 @@ From-scratch [Diffusion Policy](https://arxiv.org/abs/2303.04137) fine-tune on
|
|
| 21 |
for the LeIsaac `LeIsaac-SO101-PickOrange-v0` task in Isaac Sim (SO-101 leader arm,
|
| 22 |
front + wrist cameras, three oranges → plate).
|
| 23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
## Headline result
|
| 25 |
|
| 26 |
| Eval budget | Episodes | Success rate |
|
|
@@ -50,7 +60,7 @@ Compared to other policies trained on the same 60 ep × 36 k frame dataset:
|
|
| 50 |
- **Scheduler**: cosine with 500 warmup steps
|
| 51 |
- **Batch**: 32 per device
|
| 52 |
- **Steps**: 100,000 (resume @ 60k saved ckpt → continued to 100k under same config)
|
| 53 |
-
- **Time on 1× RTX
|
| 54 |
- **Video backend**: pyav (torchcodec + 4 workers segfaults on long runs)
|
| 55 |
- **Wandb**: disabled
|
| 56 |
|
|
|
|
| 21 |
for the LeIsaac `LeIsaac-SO101-PickOrange-v0` task in Isaac Sim (SO-101 leader arm,
|
| 22 |
front + wrist cameras, three oranges → plate).
|
| 23 |
|
| 24 |
+
## Project links
|
| 25 |
+
|
| 26 |
+
- **Training repo**: [`vitorcen/LeIsaac`](https://github.com/vitorcen/LeIsaac) —
|
| 27 |
+
fork of LightwheelAI/leisaac with the reusable fine-tune scaffold
|
| 28 |
+
(`scripts/finetune/lerobot_finetune.sh`), datasets workflow, and design docs
|
| 29 |
+
used to produce this checkpoint.
|
| 30 |
+
- **Evaluation harness**: [`vitorcen/isaaclab-experience`](https://github.com/vitorcen/isaaclab-experience) —
|
| 31 |
+
the Isaac Sim host project (LeIsaac live preview + LeRobot async-inference
|
| 32 |
+
policy_server launcher) used to run the eval rounds reported below.
|
| 33 |
+
|
| 34 |
## Headline result
|
| 35 |
|
| 36 |
| Eval budget | Episodes | Success rate |
|
|
|
|
| 60 |
- **Scheduler**: cosine with 500 warmup steps
|
| 61 |
- **Batch**: 32 per device
|
| 62 |
- **Steps**: 100,000 (resume @ 60k saved ckpt → continued to 100k under same config)
|
| 63 |
+
- **Time on 1× RTX 4090 24 GB**: ~8 h total, ~2.5 step/s steady-state
|
| 64 |
- **Video backend**: pyav (torchcodec + 4 workers segfaults on long runs)
|
| 65 |
- **Wandb**: disabled
|
| 66 |
|