nielsr HF Staff commited on
Commit
844761e
·
verified ·
1 Parent(s): 25cea99

Improve model card: Add pipeline tag, links to paper, project page, code, and expanded content

Browse files

This PR enriches the model card by:
- Adding the `pipeline_tag: robotics` to categorize the model correctly on the Hub.
- Including a link to the associated paper: [Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions](https://huggingface.co/papers/2511.04665).
- Providing links to the GitHub repository and project page for more details.
- Expanding the content with the abstract, an overview of the framework, a teaser image, and the citation information from the original GitHub README.

Please review and merge this PR.

Files changed (1) hide show
  1. README.md +36 -3
README.md CHANGED
@@ -1,3 +1,36 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: robotics
4
+ ---
5
+
6
+ # Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions
7
+
8
+ This repository contains the official implementation of the **Real-to-Sim-Policy-Eval** framework, as described in the paper [Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions](https://huggingface.co/papers/2511.04665).
9
+
10
+ **[📚 Paper](https://huggingface.co/papers/2511.04665)** | **[🌐 Project Page](https://real2sim-eval.github.io/)** | **[💻 Code](https://github.com/kywind/real2sim-eval)**
11
+
12
+ ![Teaser Image](https://github.com/kywind/real2sim-eval/raw/main/assets/media/teaser.jpg)
13
+
14
+ ## Abstract
15
+ Robotic manipulation policies are advancing rapidly, but their direct evaluation in the real world remains costly, time-consuming, and difficult to reproduce, particularly for tasks involving deformable objects. Simulation provides a scalable and systematic alternative, yet existing simulators often fail to capture the coupled visual and physical complexity of soft-body interactions. We present a real-to-sim policy evaluation framework that constructs soft-body digital twins from real-world videos and renders robots, objects, and environments with photorealistic fidelity using 3D Gaussian Splatting. We validate our approach on representative deformable manipulation tasks, including plush toy packing, rope routing, and T-block pushing, demonstrating that simulated rollouts correlate strongly with real-world execution performance and reveal key behavioral patterns of learned policies. Our results suggest that combining physics-informed reconstruction with high-quality rendering enables reproducible, scalable, and accurate evaluation of robotic manipulation policies. Website: this https URL
16
+
17
+ ## Overview
18
+ This repository contains the official implementation of the **Real-to-Sim-Policy-Eval** framework. The main components are:
19
+ - Construct simulation assets: visualize object Gaussians, articulate robot Gaussians, define and render different object layouts.
20
+ - Deploy trained [PhysTwin](https://github.com/Jianghanxiao/PhysTwin) to simulate deformable object Gaussians.
21
+ - Train policies using the [policy_training](https://github.com/shuosha/policy_training) submodule located in `policy/`.
22
+ - Evaluate policy in the constructed simulation environment.
23
+ - Interactive control of the Gaussian-based simulation.
24
+
25
+ For detailed installation instructions and examples on how to run the policy evaluation, keyboard interactive control, and motion replay, please refer to the [GitHub repository](https://github.com/kywind/real2sim-eval).
26
+
27
+ ## Citation
28
+ If you find this repo useful, please consider citing the paper:
29
+ ```bibtex
30
+ @article{zhang2025real,
31
+ title={Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions},
32
+ author={Zhang, Kaifeng and Sha, Shuo and Jiang, Hanxiao and Loper, Matthew and Song, Hyunjong and Cai, Guangyan and Xu, Zhuo and Hu, Xiaochen and Zheng, Changxi and Li, Yunzhu},
33
+ journal={arXiv preprint arXiv:2511.04665},
34
+ year={2025}
35
+ }
36
+ ```