README.md

---
license: apache-2.0
pipeline_tag: image-to-video
---

# SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation

SymphoMotion is a unified motion-control framework that jointly governs camera trajectories and object dynamics within a single model. It features a Camera Trajectory Control mechanism that integrates explicit camera paths with geometry-aware cues, and an Object Dynamics Control mechanism that combines 2D visual guidance with 3D trajectory embeddings.

[![Project Website](https://img.shields.io/badge/Project-Website-blue)](https://grenoble-zhang.github.io/SymphoMotion/) 
[![arXiv](https://img.shields.io/badge/arXiv-2604.03723-b31b1b.svg)](https://arxiv.org/abs/2604.03723) 
[![GitHub](https://img.shields.io/badge/GitHub-SymphoMotion-blue?logo=github)](https://github.com/grenoble-zhang/SymphoMotion)

<img src="https://raw.githubusercontent.com/Grenoble-Zhang/SymphoMotion/main/img/method.png" width="100%"/>

## Quick Start & Installation

To set up the environment and use these checkpoints, please refer to the instructions below or check out the [Official Codebase](https://github.com/grenoble-zhang/SymphoMotion).

```bash
git clone https://github.com/Grenoble-Zhang/SymphoMotion.git
cd SymphoMotion

# Create conda environment
conda create -n symphomotion python=3.10
conda activate symphomotion

# Install dependencies
pip install -r requirements.txt
```

### Download Models

```bash
# Base model
huggingface-cli download Wan-AI/Wan2.1-I2V-14B-720P-Diffusers \
  --local-dir pretrained_models/Wan2.1-I2V-14B-720P-Diffusers

# SymphoMotion checkpoints
huggingface-cli download fateforward/Symphomotion \
  --include "pretrained_checkpoints/*" \
  --local-dir .
```

## Citation

```bibtex
@article{zhang2026symphomotion,
  title={SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation},
  author={Zhang, Guiyu and Chen, Yabo and Xiang, Xunzhi and Huang, Junchao and Wang, Zhongyu and Jiang, Li},
  journal={arXiv preprint arXiv:2604.03723},
  year={2026}
}
```