Instructions to use HorizonRobotics/RoboTransfer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use HorizonRobotics/RoboTransfer with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("HorizonRobotics/RoboTransfer", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,4 +1,21 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
library_name: diffusers
|
| 4 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
<div align="center" class="authors"> <a href="https://scholar.google.com/citations?user=XXXXXX" target="_blank">Author A</a>, <a href="https://scholar.google.com/citations?user=XXXXXX" target="_blank">Author B</a>, <a href="https://scholar.google.com/citations?user=XXXXXX" target="_blank">Author C</a>, <a href="https://scholar.google.com/citations?user=XXXXXX" target="_blank">Author D</a>, <a href="https://scholar.google.com/citations?user=XXXXXX" target="_blank">Author E</a> </div> <div align="center" style="line-height: 3;"> <a href="https://github.com/horizonrobotics/robot_lab" target="_blank" style="margin: 2px;"> <img alt="Code" src="https://img.shields.io/badge/Code-Github-blue" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://horizonrobotics.github.io/robot_lab/robotransfer" target="_blank" style="margin: 2px;"> <img alt="Project Page" src="https://img.shields.io/badge/🌐-Project_Page-blue" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://arxiv.org/abs/2505.23171" target="_blank" style="margin: 2px;"> <img alt="arXiv" src="https://img.shields.io/badge/📄-arXiv-b31b1b" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://youtu.be/dGXKtqDnm5Q" target="_blank" style="margin: 2px;"> <img alt="Video" src="https://img.shields.io/badge/🎥-Video-red" style="display: inline-block; vertical-align: middle;"/> </a> <a href="https://mp.weixin.qq.com/s/c9-1HPBMHIy4oEwyKnsT7Q" target="_blank" style="margin: 2px;"> <img alt="中文介绍" src="https://img.shields.io/badge/中文介绍-07C160?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/> </a> </div> <div align="center"> <img src="assets/pin/robotransfer.png" width="90%" alt="RoboTransfer Overview"/> <p style="font-size:0.8em; color:#555;">The RoboTransfer framework integrates multi-view geometry and video diffusion, enabling controllable and geometry-consistent robotic video synthesis for policy transfer.</p> </div>
|
| 7 |
+
|
| 8 |
+
📖 中文介绍
|
| 9 |
+
|
| 10 |
+
## Citation
|
| 11 |
+
```
|
| 12 |
+
@misc{liu2025robotransfergeometryconsistentvideodiffusion,
|
| 13 |
+
title={RoboTransfer: Geometry-Consistent Video Diffusion for Robotic Visual Policy Transfer},
|
| 14 |
+
author={Liu Liu and Xiaofeng Wang and Guosheng Zhao and Keyu Li and Wenkang Qin and Jiaxiong Qiu and Zheng Zhu and Guan Huang and Zhizhong Su},
|
| 15 |
+
year={2025},
|
| 16 |
+
eprint={2505.23171},
|
| 17 |
+
archivePrefix={arXiv},
|
| 18 |
+
primaryClass={cs.CV},
|
| 19 |
+
url={https://arxiv.org/abs/2505.23171},
|
| 20 |
+
}
|
| 21 |
+
```
|