Add model card with paper, project page, code links, and robotics tag

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +35 -3
README.md CHANGED
@@ -1,3 +1,35 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: robotics
4
+ ---
5
+
6
+ # Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions
7
+
8
+ This repository contains the official implementation of the **Real-to-Sim-Policy-Eval** framework, introduced in the paper "[Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions](https://huggingface.co/papers/2511.04665)".
9
+
10
+ The framework constructs soft-body digital twins from real-world videos and renders robots, objects, and environments with photorealistic fidelity using 3D Gaussian Splatting. It enables reproducible, scalable, and accurate evaluation of robotic manipulation policies, particularly for tasks involving deformable objects.
11
+
12
+ Project page: https://real2sim-eval.github.io/
13
+
14
+ Code: https://github.com/kywind/real2sim-eval
15
+
16
+ ## Overview
17
+ The main components of the framework include:
18
+ - Construction of simulation assets: visualizing object Gaussians, articulating robot Gaussians, defining and rendering different object layouts.
19
+ - Deployment of trained PhysTwin for simulating deformable object Gaussians.
20
+ - Training policies using a dedicated policy training submodule.
21
+ - Evaluation of policies within the constructed simulation environment.
22
+ - Interactive control of the Gaussian-based simulation.
23
+
24
+ More details can be found on the project page and in the GitHub repository.
25
+
26
+ ## Citation
27
+ If you find this work useful, please consider citing the paper:
28
+ ```bibtex
29
+ @article{zhang2025real,
30
+ title={Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions},
31
+ author={Zhang, Kaifeng and Sha, Shuo and Jiang, Hanxiao and Loper, Matthew and Song, Hyunjong and Cai, Guangyan and Xu, Zhuo and Hu, Xiaochen and Zheng, Changxi and Li, Yunzhu},
32
+ journal={arXiv preprint arXiv:2511.04665},
33
+ year={2025}
34
+ }
35
+ ```