Add model card for AnyPos

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +53 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: robotics
3
+ ---
4
+
5
+ # AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulation
6
+
7
+ AnyPos is a unified pipeline that integrates large-scale automated task-agnostic exploration with robust embodiment modeling through inverse dynamics learning. It learns embodiment dynamics directly from task-agnostic action data and decouples them from high-level policy learning, enabling scalable reuse of action data across different tasks and platforms.
8
+
9
+ - **Paper:** [AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulation](https://huggingface.co/papers/2507.12768)
10
+ - **Project Page:** [https://embodiedfoundation.github.io/vidar_anypos](https://embodiedfoundation.github.io/vidar_anypos)
11
+ - **Repository:** [https://github.com/yaofeng1998/Vidar](https://github.com/yaofeng1998/Vidar)
12
+
13
+ ## Introduction
14
+
15
+ Learning generalizable manipulation policies hinges on data, yet robot manipulation data is scarce and often entangled with specific embodiments. AnyPos tackles this challenge by focusing on exploring all feasible actions of the embodiment to capture what is physically feasible and consistent. Building on this principle, AnyPos generates diverse yet safe trajectories at scale, then learns embodiment representations by decoupling arm and end-effector motions. The pipeline can be seamlessly coupled with diverse high-level policy models.
16
+
17
+ ## Environment Setup
18
+
19
+ To set up the environment for Vidar/AnyPos, follow these steps:
20
+
21
+ ```bash
22
+ conda create -n vidar python==3.11.9
23
+ conda activate vidar
24
+ conda install pytorch==2.4.0 torchvision==0.19.0 torchaudio==2.4.0 pytorch-cuda=12.4 -c pytorch -c nvidia
25
+ python -m pip install -r requirements.txt
26
+ ```
27
+
28
+ ## Usage
29
+
30
+ The repository provides scripts for inference and evaluation of the Video Diffusion Model (VM) and the Masked Inverse Dynamic Model (IDM).
31
+
32
+ ### Video Diffusion Model Inference
33
+ To generate a video based on an initial frame and instruction:
34
+ ```bash
35
+ scripts/vm/sample.sh
36
+ ```
37
+
38
+ ### Masked Inverse Dynamic Model Evaluation
39
+ To evaluate the model:
40
+ ```bash
41
+ scripts/idm/eval.sh
42
+ ```
43
+
44
+ ## Citation
45
+
46
+ ```bibtex
47
+ @article{zhou2025anypos,
48
+ title={AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulation},
49
+ author={Zhou, Feng and others},
50
+ journal={arXiv preprint arXiv:2507.12768},
51
+ year={2025}
52
+ }
53
+ ```