Improve model card: add metadata, paper links, and project information

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +58 -53
README.md CHANGED
@@ -1,53 +1,58 @@
1
- ---
2
- license: cc-by-4.0
3
- ---
4
- # πŸ“¦ Pretrained Weights
5
-
6
- This directory stores the pretrained weights used in **MACE-Dance**, including both **expert models** and **evaluation models**.
7
-
8
- ---
9
-
10
- ## πŸ—‚οΈ Directory Structure
11
-
12
- ```bash
13
- weight/
14
- β”œβ”€β”€ Evaluation-Appearance/
15
- β”‚ └── Evaluation-Appearance.7z
16
- β”œβ”€β”€ Evaluation-Motion/
17
- β”‚ └── Evaluation-Motion.7z
18
- β”œβ”€β”€ Expert-Appearance/
19
- β”‚ └── Expert-Apprearance.7z
20
- └── Expert-Motion/
21
- └── Expert-Motion.7z
22
- ```
23
-
24
- ---
25
-
26
- ## πŸ“˜ Description
27
-
28
- - 🎭 **Expert-Appearance**
29
- Pretrained weights for the **Appearance Expert**
30
-
31
- - πŸ•Ί **Expert-Motion**
32
- Pretrained weights for the **Motion Expert**
33
-
34
- - πŸ“Š **Evaluation-Appearance**
35
- Weights used for **appearance-related evaluation**
36
-
37
- - πŸ“ˆ **Evaluation-Motion**
38
- Weights used for **motion-related evaluation**
39
-
40
- ---
41
-
42
- ## πŸ“ Notes
43
-
44
- - Each subfolder contains a compressed **`.7z`** package
45
- - Please extract the corresponding file before use
46
- - Make sure the extracted weights are placed in the expected paths for training, inference, or evaluation
47
-
48
- ---
49
-
50
- ## πŸ”§ Usage Reminder
51
-
52
- - Use **Expert-\*** weights for model inference or expert initialization
53
- - Use **Evaluation-\*** weights for metric computation or evaluation pipelines
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ pipeline_tag: image-to-video
4
+ ---
5
+
6
+ # MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generation
7
+
8
+ [**Paper**](https://arxiv.org/abs/2512.18181) | [**Project Page**](https://macedance.github.io/) | [**GitHub**](https://github.com/AMAP-ML/MACE-Dance)
9
+
10
+ MACE-Dance is a cascaded expert framework for music-driven dance video generation. It explicitly decouples motion generation and appearance synthesis to produce kinematically plausible, artistically expressive, and visually coherent dance videos.
11
+
12
+ The framework consists of two main components:
13
+ - **Motion Expert**: Performs music-to-3D motion generation (SMPL) using a diffusion model with a BiMamba-Transformer architecture.
14
+ - **Appearance Expert**: Synthesizes the final dance video conditioned on the motion and a reference image, ensuring visual identity and spatiotemporal coherence.
15
+
16
+ ## πŸ“¦ Pretrained Weights
17
+
18
+ This repository stores the pretrained weights used in **MACE-Dance**, including both **expert models** and **evaluation models**.
19
+
20
+ ### πŸ—‚οΈ Directory Structure
21
+
22
+ ```bash
23
+ weight/
24
+ β”œβ”€β”€ Evaluation-Appearance/
25
+ β”‚ └── Evaluation-Appearance.7z
26
+ β”œβ”€β”€ Evaluation-Motion/
27
+ β”‚ └── Evaluation-Motion.7z
28
+ β”œβ”€β”€ Expert-Appearance/
29
+ β”‚ └── Expert-Apprearance.7z
30
+ └── Expert-Motion/
31
+ └── Expert-Motion.7z
32
+ ```
33
+
34
+ ### πŸ“˜ Description
35
+
36
+ - 🎭 **Expert-Appearance**: Pretrained weights for the **Appearance Expert** (motion-guided video synthesis).
37
+ - πŸ•Ί **Expert-Motion**: Pretrained weights for the **Motion Expert** (music-to-3D dance motion).
38
+ - πŸ“Š **Evaluation-Appearance**: Weights used for **appearance-related evaluation** (based on VBench).
39
+ - πŸ“ˆ **Evaluation-Motion**: Weights used for **motion-related evaluation** (based on ViTPose).
40
+
41
+ ## πŸ“ Notes
42
+
43
+ - Each subfolder contains a compressed **`.7z`** package. Please extract the corresponding file before use.
44
+ - Make sure the extracted weights are placed in the expected paths for training, inference, or evaluation as specified in the [official code repository](https://github.com/AMAP-ML/MACE-Dance).
45
+ - Use **Expert-*** weights for model inference and **Evaluation-*** weights for metric computation pipelines.
46
+
47
+ ## πŸ“„ Citation
48
+
49
+ If you find this project useful, please consider citing the paper:
50
+
51
+ ```bibtex
52
+ @article{yang2026macedance,
53
+ title={MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generation},
54
+ author={Yang, Kaixing and Zhu, Jiashu and Tang, Xulong and Peng, Ziqiao and Zhang, Xiangyue and Wang, Puwei and Jiahong Wu and Chu, Xiangxiang and Liu, Hongyan and He, Jun},
55
+ journal={ACM Transactions on Graphics (SIGGRAPH 2026)},
56
+ year={2026}
57
+ }
58
+ ```