Improve model card with pipeline tag, paper, project page, and GitHub links
Browse filesThis PR enhances the model card by:
- Adding the `pipeline_tag: robotics` for better discoverability on the Hugging Face Hub.
- Including direct links to the official paper, the project page, and the GitHub repository.
- Providing a concise overview of the framework's components, including a teaser image and video demonstrations from the GitHub README.
- Adding the BibTeX citation for proper attribution.
Please review and merge this PR if these improvements are satisfactory.
README.md
CHANGED
|
@@ -1,3 +1,49 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: robotics
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
# Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions
|
| 7 |
+
|
| 8 |
+
This repository contains the official implementation of the **Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions** framework, presented in the paper [Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions](https://huggingface.co/papers/2511.04665).
|
| 9 |
+
|
| 10 |
+
This framework introduces a novel real-to-sim policy evaluation approach that constructs soft-body digital twins from real-world videos and renders robots, objects, and environments with photorealistic fidelity using 3D Gaussian Splatting. It aims to provide a scalable, systematic, and accurate alternative for evaluating robotic manipulation policies, particularly for tasks involving deformable objects.
|
| 11 |
+
|
| 12 |
+
**Project Page:** https://real2sim-eval.github.io/
|
| 13 |
+
**Code:** https://github.com/kywind/real2sim-eval
|
| 14 |
+
|
| 15 |
+
<div align="center">
|
| 16 |
+
<img src="https://github.com/kywind/real2sim-eval/blob/main/assets/media/teaser.jpg" alt="Teaser Image" width="790"/>
|
| 17 |
+
</div>
|
| 18 |
+
|
| 19 |
+
## Overview
|
| 20 |
+
|
| 21 |
+
This repository contains the official implementation of the **Real-to-Sim-Policy-Eval** framework. The main components are:
|
| 22 |
+
|
| 23 |
+
- Construct simulation assets: visualize object Gaussians, articulate robot Gaussians, define and render different object layouts.
|
| 24 |
+
- Deploy trained [PhysTwin](https://github.com/Jianghanxiao/PhysTwin) to simulate deformable object Gaussians.
|
| 25 |
+
- Train policies using the [policy_training](https://github.com/shuosha/policy_training) submodule located in `policy/`.
|
| 26 |
+
- Evaluate policy in the constructed simulation environment.
|
| 27 |
+
- Interactive control of the Gaussian-based simulation.
|
| 28 |
+
|
| 29 |
+
<div align="center">
|
| 30 |
+
<video controls src="https://github.com/user-attachments/assets/a43362e9-26c6-48c5-8edd-8995c2c45c08"></video>
|
| 31 |
+
</div>
|
| 32 |
+
<div align="center">
|
| 33 |
+
<video controls src="https://github.com/user-attachments/assets/e870efef-1974-45bc-ab9e-0c639238894a"></video>
|
| 34 |
+
</div>
|
| 35 |
+
|
| 36 |
+
For detailed installation instructions, usage examples for policy evaluation, keyboard interactive control, motion replay, and policy training, please refer to the [GitHub repository](https://github.com/kywind/real2sim-eval).
|
| 37 |
+
|
| 38 |
+
## Citation
|
| 39 |
+
|
| 40 |
+
If you find this repo useful, please consider citing the paper:
|
| 41 |
+
|
| 42 |
+
```bibtex
|
| 43 |
+
@article{zhang2025real,
|
| 44 |
+
title={Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions},
|
| 45 |
+
author={Zhang, Kaifeng and Sha, Shuo and Jiang, Hanxiao and Loper, Matthew and Song, Hyunjong and Cai, Guangyan and Xu, Zhuo and Hu, Xiaochen and Zheng, Changxi and Li, Yunzhu},
|
| 46 |
+
journal={arXiv preprint arXiv:2511.04665},
|
| 47 |
+
year={2025}
|
| 48 |
+
}
|
| 49 |
+
```
|