README.md

---
license: cc-by-4.0
pipeline_tag: image-to-video
---

# MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generation

[**Paper**](https://arxiv.org/abs/2512.18181) | [**Project Page**](https://macedance.github.io/) | [**GitHub**](https://github.com/AMAP-ML/MACE-Dance)

MACE-Dance is a cascaded expert framework for music-driven dance video generation. It explicitly decouples motion generation and appearance synthesis to produce kinematically plausible, artistically expressive, and visually coherent dance videos.

The framework consists of two main components:
- **Motion Expert**: Performs music-to-3D motion generation (SMPL) using a diffusion model with a BiMamba-Transformer architecture.
- **Appearance Expert**: Synthesizes the final dance video conditioned on the motion and a reference image, ensuring visual identity and spatiotemporal coherence.

## 📦 Pretrained Weights

This repository stores the pretrained weights used in **MACE-Dance**, including both **expert models** and **evaluation models**.

### 🗂️ Directory Structure

```bash
weight/
├── Evaluation-Appearance/
│   └── Evaluation-Appearance.7z
├── Evaluation-Motion/
│   └── Evaluation-Motion.7z
├── Expert-Appearance/
│   └── Expert-Apprearance.7z
└── Expert-Motion/
    └── Expert-Motion.7z
```

### 📘 Description

- 🎭 **Expert-Appearance**: Pretrained weights for the **Appearance Expert** (motion-guided video synthesis).
- 🕺 **Expert-Motion**: Pretrained weights for the **Motion Expert** (music-to-3D dance motion).
- 📊 **Evaluation-Appearance**: Weights used for **appearance-related evaluation** (based on VBench).
- 📈 **Evaluation-Motion**: Weights used for **motion-related evaluation** (based on ViTPose).

## 📝 Notes

- Each subfolder contains a compressed **`.7z`** package. Please extract the corresponding file before use.
- Make sure the extracted weights are placed in the expected paths for training, inference, or evaluation as specified in the [official code repository](https://github.com/AMAP-ML/MACE-Dance).
- Use **Expert-*** weights for model inference and **Evaluation-*** weights for metric computation pipelines.

## 📄 Citation

If you find this project useful, please consider citing the paper:

```bibtex
@article{yang2026macedance,
  title={MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generation},
  author={Yang, Kaixing and Zhu, Jiashu and Tang, Xulong and Peng, Ziqiao and Zhang, Xiangyue and Wang, Puwei and Jiahong Wu and Chu, Xiangxiang and Liu, Hongyan and He, Jun},
  journal={ACM Transactions on Graphics (SIGGRAPH 2026)},
  year={2026}
}
```