Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,57 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: cc-by-nc-sa-4.0
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-nc-sa-4.0
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
|
| 6 |
+
<div align="center">
|
| 7 |
+
|
| 8 |
+
<h2>
|
| 9 |
+
EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
|
| 10 |
+
</h2>
|
| 11 |
+
|
| 12 |
+
</div>
|
| 13 |
+
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
|
| 17 |
+
|
| 18 |
+
<div align="center">
|
| 19 |
+
<a href="https://github.com/AgibotTech/EWMBench">
|
| 20 |
+
<img src="https://img.shields.io/badge/GitHub-grey?logo=GitHub" alt="GitHub">
|
| 21 |
+
</a>
|
| 22 |
+
|
| 23 |
+
<a href="https://arxiv">
|
| 24 |
+
<img src="https://img.shields.io/badge/arXiv-2504.18428-b31b1b.svg?logo=arxiv" alt="arXiv"/>
|
| 25 |
+
</a>
|
| 26 |
+
|
| 27 |
+
</div>
|
| 28 |
+
|
| 29 |
+
|
| 30 |
+
<img src="figs/pipe.jpg" alt="Image Alt Text" width="50%" style="display: block; margin-left: auto; margin-right: auto;" />
|
| 31 |
+
|
| 32 |
+
<img src="figs/dataset.jpg" alt="Image Alt Text" width="50%" style="display: block; margin-left: auto; margin-right: auto;" />
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
### Resources
|
| 37 |
+
|
| 38 |
+
- 🐙 **GitHub**: Explore the project repository to run evaluation script. [AgibotTech/EWMBench](https://github.com/AgibotTech/EWMBench).
|
| 39 |
+
- 📑 **arXiv**: Read our paper for detailed methodology and results at [arXiv:xxx.xxxx](https://arxiv.org/abs/xxx.xxx).
|
| 40 |
+
- 🤗 **Data**: Discover [EWMBench Dataset](https://huggingface.co/datasets/agibot-world/EWMBench/tree/main), we sample a diverse dataset from AgiBot World for running EWMBench evaluation.
|
| 41 |
+
- 🤗 **Model**: Download pretrained weights used for evaluation from [EWMBench-model](https://huggingface.co/agibot-world/EWMBench-model/tree/main).
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
**For running evaluation script, please download necessary [model weights](https://huggingface.co/agibot-world/EWMBench-model/tree/main) and modify the config.yaml to specify weigthts path, following the instruction in [EWMBench github repo](https://github.com/AgibotTech/EWMBench).**
|
| 45 |
+
|
| 46 |
+
|
| 47 |
+
# License and Citation
|
| 48 |
+
All the data and code within this repo are under [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/). Please consider citing our project if it helps your research.
|
| 49 |
+
|
| 50 |
+
```BibTeX
|
| 51 |
+
@misc{contributors2025geniesimrepo,
|
| 52 |
+
title={Genie Sim Assets},
|
| 53 |
+
author={Genie Sim Team},
|
| 54 |
+
howpublished={https://github.com/AgibotTech/genie_sim},
|
| 55 |
+
year={2025}
|
| 56 |
+
}
|
| 57 |
+
```
|