---
license: other
license_name: openmdw-1.1
license_link: https://github.com/NVIDIA/Cosmos/blob/main/LICENSE
pipeline_tag: image-to-video
tags:
  - robotics
  - world-model
  - forward-dynamics
  - image-to-video
---

<br/>
  <h1 align="center" style="font-size: 1.7rem">SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators</h1>
  <p align="center">
    <a href="https://yyuncong.github.io/">Yuncong Yang</a>,
    <a href="https://www.hanzht.com/">Zhengtao Han</a>,
    <a href="https://www.linkedin.com/in/ozyurtf/">Furkan Özyurt</a>,
    <a href="https://miicheyang.github.io/">Zeyuan Yang</a>,
    <a href="https://hanyangclarence.github.io/">Han Yang</a>,
    <a href="https://xjay18.github.io/">Junyi Cao</a>,
    <a href="https://haoyuzhen.com/">Haoyu Zhen</a>,
    <a href="https://yilundu.github.io/">Yilun Du</a>,
    <a href="https://people.csail.mit.edu/ganchuang/">Chuang Gan</a>
  </p>
  <p align="center">
    <a href="https://arxiv.org/abs/2609.09155">
      <img src='https://img.shields.io/badge/Paper-PDF-red?style=flat&logo=arXiv&logoColor=red' alt='Paper PDF'>
    </a>
    <a href='https://umass-embodied-agi.github.io/SyncWorld/' style='padding-left: 0.5rem;'>
      <img src='https://img.shields.io/badge/Project-Page-blue?style=flat&logo=Google%20chrome&logoColor=blue' alt='Project Page'>
    </a>
    <a href='https://github.com/UMass-Embodied-AGI/SyncWorld' style='padding-left: 0.5rem;'>
      <img src='https://img.shields.io/badge/Code-GitHub-black?style=flat&logo=github&logoColor=white' alt='Code'>
    </a>
  </p>


</p>


SyncWorld is an action-conditioned world model that serves as a zero-shot simulator across unseen
environments without any additional training. It leverages a visual calibration episode — paired
frames and actions that showcase all the controllable degrees of freedom — to specify the
setup-specific Action–Visual Mapping in context, and learns to interpret actions through visual
evidence and to fall back on interaction history when explicit calibration is unavailable.

```shell
hf download yyuncong/SyncWorld --local-dir ./SyncWorld-ckpt
```

See the [SyncWorld repository](https://github.com/UMass-Embodied-AGI/SyncWorld) for installation and how to
run evaluation, and [`yyuncong/SyncWorld-Evaluation`](https://huggingface.co/datasets/yyuncong/SyncWorld-Evaluation)
for the evaluation sets.