--- datasets: - lerobot/pusht library_name: lerobot license: apache-2.0 model_name: diffusion pipeline_tag: robotics tags: - lerobot - robotics - diffusion - pusht - imitation-learning - phase-1 --- # 🦾 Diffusion Policy for Push-T (Phase 1: 100k Steps) [![LeRobot](https://img.shields.io/badge/Library-LeRobot-yellow)](https://github.com/huggingface/lerobot) [![Task](https://img.shields.io/badge/Task-Push--T-blue)](https://huggingface.co/datasets/lerobot/pusht) [![UESTC](https://img.shields.io/badge/Author-UESTC_Graduate-red)](https://www.uestc.edu.cn/) [![Phase](https://img.shields.io/badge/Training_Phase-Initial-orange)](https://huggingface.co/Lemon-03/DP_PushT_test) > **Summary:** This model represents the **initial training phase (0 - 100k steps)** of a Diffusion Policy on the Push-T task. It serves as the pre-trained foundation for further fine-tuning. While it demonstrates strong trajectory learning capabilities, it has not yet fully converged to high success rates. - **🧩 Task**: Push-T (Simulated) - **🧠 Algorithm**: [Diffusion Policy](https://huggingface.co/papers/2303.04137) (DDPM) - **🔄 Training Steps**: 100,000 (Initial Phase) - **🎓 Author**: Graduate Student, **UESTC** (University of Electronic Science and Technology of China) --- ## ⚠️ Note on Performance & Fine-tuning This checkpoint represents the **intermediate state** of our research. While it achieves high movement precision (**Avg Max Reward: 0.71**), the strict success threshold of the Push-T task results in a lower success rate at this stage. ### 🚀 **Upgrade Available:** We performed **Resume Training (Fine-tuning)** based on this checkpoint for another 100k steps, achieving significantly better results. 👉 **Check out the final model here:** [**Lemon-03/DP_PushT_test_Resume**](https://huggingface.co/Lemon-03/DP_PushT_test_Resume) --- ## 🔬 Benchmark Results (Phase 1) Evaluated on **50 episodes** in the `Push-T` environment using LeRobot. | Metric | Value | Status | | :--- | :---: | :---: | | **Success Rate** | **4.0%** | 🚧 (Under-trained) | | **Avg Max Reward** | **0.71** | 📈 (High Precision) | | **Avg Sum Reward** | **115.03** | ✅ (Good Trajectory) | > **Analysis:** The model has successfully learned the multimodal distribution of the demonstration data and can push the T-block close to the target (Reward 0.71). However, it lacks the final fine-grained adjustment capabilities required for the >95% overlap success criteria. This motivated the subsequent **Phase 2 (Resume Training)**. --- ## ⚙️ Model Details | Parameter | Description | | :--- | :--- | | **Architecture** | ResNet18 (Vision Backbone) + U-Net (Diffusion Head) | | **Prediction Horizon** | 16 steps | | **Observation History** | 2 steps | | **Action Steps** | 8 steps | --- ## 🔧 Training Configuration (Reference) For reproducibility, here are the key parameters used during this initial training session: - **Batch Size**: 8 (Effective) - **Optimizer**: AdamW (`lr=1e-4`) - **Scheduler**: Cosine with warmup - **Vision**: ResNet18 with random crop (84x84) #### Original Training Command (My Training Mode) ```bash python -m lerobot.scripts.lerobot_train \ --policy.type diffusion \ --env.type pusht \ --dataset.repo_id lerobot/pusht \ --wandb.enable true \ --job_name DP_PushT \ --policy.repo_id Lemon-03/DP_PushT_test \ --eval.batch_size 8 ```` ----- ## 🚀 Evaluate (My Evaluation Mode) Run the following command in your terminal to evaluate the model for 50 episodes and save the visualization videos: ```bash python -m lerobot.scripts.lerobot_eval \ --policy.type diffusion \ --policy.pretrained_path outputs/train/2025-12-02/14-33-35_DP_PushT/checkpoints/last/pretrained_model \ --eval.n_episodes 50 \ --eval.batch_size 10 \ --env.type pusht \ --env.task PushT-v0 ``` You can evaluate this checkpoint to reproduce the Phase 1 results: ```bash python -m lerobot.scripts.lerobot_eval \ --policy.type diffusion \ --policy.pretrained_path Lemon-03/DP_PushT_test \ --eval.n_episodes 50 \ --eval.batch_size 10 \ --env.type pusht \ --env.task PushT-v0 ```