Add model card for AnyPos
#1
by nielsr HF Staff - opened
README.md
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: robotics
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulation
|
| 6 |
+
|
| 7 |
+
AnyPos is a unified pipeline that integrates large-scale automated task-agnostic exploration with robust embodiment modeling through inverse dynamics learning. It learns embodiment dynamics directly from task-agnostic action data and decouples them from high-level policy learning, enabling scalable reuse of action data across different tasks and platforms.
|
| 8 |
+
|
| 9 |
+
- **Paper:** [AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulation](https://huggingface.co/papers/2507.12768)
|
| 10 |
+
- **Project Page:** [https://embodiedfoundation.github.io/vidar_anypos](https://embodiedfoundation.github.io/vidar_anypos)
|
| 11 |
+
- **Repository:** [https://github.com/yaofeng1998/Vidar](https://github.com/yaofeng1998/Vidar)
|
| 12 |
+
|
| 13 |
+
## Introduction
|
| 14 |
+
|
| 15 |
+
Learning generalizable manipulation policies hinges on data, yet robot manipulation data is scarce and often entangled with specific embodiments. AnyPos tackles this challenge by focusing on exploring all feasible actions of the embodiment to capture what is physically feasible and consistent. Building on this principle, AnyPos generates diverse yet safe trajectories at scale, then learns embodiment representations by decoupling arm and end-effector motions. The pipeline can be seamlessly coupled with diverse high-level policy models.
|
| 16 |
+
|
| 17 |
+
## Environment Setup
|
| 18 |
+
|
| 19 |
+
To set up the environment for Vidar/AnyPos, follow these steps:
|
| 20 |
+
|
| 21 |
+
```bash
|
| 22 |
+
conda create -n vidar python==3.11.9
|
| 23 |
+
conda activate vidar
|
| 24 |
+
conda install pytorch==2.4.0 torchvision==0.19.0 torchaudio==2.4.0 pytorch-cuda=12.4 -c pytorch -c nvidia
|
| 25 |
+
python -m pip install -r requirements.txt
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
+
## Usage
|
| 29 |
+
|
| 30 |
+
The repository provides scripts for inference and evaluation of the Video Diffusion Model (VM) and the Masked Inverse Dynamic Model (IDM).
|
| 31 |
+
|
| 32 |
+
### Video Diffusion Model Inference
|
| 33 |
+
To generate a video based on an initial frame and instruction:
|
| 34 |
+
```bash
|
| 35 |
+
scripts/vm/sample.sh
|
| 36 |
+
```
|
| 37 |
+
|
| 38 |
+
### Masked Inverse Dynamic Model Evaluation
|
| 39 |
+
To evaluate the model:
|
| 40 |
+
```bash
|
| 41 |
+
scripts/idm/eval.sh
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
## Citation
|
| 45 |
+
|
| 46 |
+
```bibtex
|
| 47 |
+
@article{zhou2025anypos,
|
| 48 |
+
title={AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulation},
|
| 49 |
+
author={Zhou, Feng and others},
|
| 50 |
+
journal={arXiv preprint arXiv:2507.12768},
|
| 51 |
+
year={2025}
|
| 52 |
+
}
|
| 53 |
+
```
|