Improve model card with pipeline tag, paper, project page, and GitHub links

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +49 -3
README.md CHANGED
@@ -1,3 +1,49 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: robotics
4
+ ---
5
+
6
+ # Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions
7
+
8
+ This repository contains the official implementation of the **Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions** framework, presented in the paper [Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions](https://huggingface.co/papers/2511.04665).
9
+
10
+ This framework introduces a novel real-to-sim policy evaluation approach that constructs soft-body digital twins from real-world videos and renders robots, objects, and environments with photorealistic fidelity using 3D Gaussian Splatting. It aims to provide a scalable, systematic, and accurate alternative for evaluating robotic manipulation policies, particularly for tasks involving deformable objects.
11
+
12
+ **Project Page:** https://real2sim-eval.github.io/
13
+ **Code:** https://github.com/kywind/real2sim-eval
14
+
15
+ <div align="center">
16
+ <img src="https://github.com/kywind/real2sim-eval/blob/main/assets/media/teaser.jpg" alt="Teaser Image" width="790"/>
17
+ </div>
18
+
19
+ ## Overview
20
+
21
+ This repository contains the official implementation of the **Real-to-Sim-Policy-Eval** framework. The main components are:
22
+
23
+ - Construct simulation assets: visualize object Gaussians, articulate robot Gaussians, define and render different object layouts.
24
+ - Deploy trained [PhysTwin](https://github.com/Jianghanxiao/PhysTwin) to simulate deformable object Gaussians.
25
+ - Train policies using the [policy_training](https://github.com/shuosha/policy_training) submodule located in `policy/`.
26
+ - Evaluate policy in the constructed simulation environment.
27
+ - Interactive control of the Gaussian-based simulation.
28
+
29
+ <div align="center">
30
+ <video controls src="https://github.com/user-attachments/assets/a43362e9-26c6-48c5-8edd-8995c2c45c08"></video>
31
+ </div>
32
+ <div align="center">
33
+ <video controls src="https://github.com/user-attachments/assets/e870efef-1974-45bc-ab9e-0c639238894a"></video>
34
+ </div>
35
+
36
+ For detailed installation instructions, usage examples for policy evaluation, keyboard interactive control, motion replay, and policy training, please refer to the [GitHub repository](https://github.com/kywind/real2sim-eval).
37
+
38
+ ## Citation
39
+
40
+ If you find this repo useful, please consider citing the paper:
41
+
42
+ ```bibtex
43
+ @article{zhang2025real,
44
+ title={Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions},
45
+ author={Zhang, Kaifeng and Sha, Shuo and Jiang, Hanxiao and Loper, Matthew and Song, Hyunjong and Cai, Guangyan and Xu, Zhuo and Hu, Xiaochen and Zheng, Changxi and Li, Yunzhu},
46
+ journal={arXiv preprint arXiv:2511.04665},
47
+ year={2025}
48
+ }
49
+ ```