Sync model card with GitHub README
Browse files- .gitattributes +1 -0
- README.md +94 -36
- flowerteaser.png +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
flowerteaser.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -8,62 +8,120 @@ tags:
|
|
| 8 |
- bimamba
|
| 9 |
---
|
| 10 |
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
-
|
| 16 |
|
| 17 |
-
|
| 18 |
-
[Project Page](https://sun-happy-ykx.github.io/FlowerDance/) |
|
| 19 |
-
[GitHub](https://github.com/XulongT/FlowerDance)
|
| 20 |
|
| 21 |
-
|
| 22 |
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
-
|
|
|
|
|
|
|
| 33 |
|
| 34 |
-
|
|
|
|
|
|
|
| 35 |
|
| 36 |
-
``
|
| 37 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
|
| 39 |
-
checkpoint_path = hf_hub_download(
|
| 40 |
-
repo_id="xlt99/FlowerDance",
|
| 41 |
-
filename="train-3700.pt",
|
| 42 |
-
)
|
| 43 |
-
print(checkpoint_path)
|
| 44 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
|
| 46 |
-
|
| 47 |
-
[official code](https://github.com/XulongT/FlowerDance), place it at:
|
| 48 |
|
| 49 |
-
```
|
| 50 |
-
|
|
|
|
| 51 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
-
|
| 54 |
|
| 55 |
-
## Citation
|
| 56 |
|
| 57 |
```bibtex
|
| 58 |
-
@
|
| 59 |
title={FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generation},
|
| 60 |
author={Kaixing Yang and Xulong Tang and Ziqiao Peng and Xiangyue Zhang and Puwei Wang and Jun He and Hongyan Liu},
|
| 61 |
-
|
| 62 |
-
year={
|
| 63 |
}
|
| 64 |
```
|
| 65 |
-
|
| 66 |
-
## License
|
| 67 |
-
|
| 68 |
-
The release does not currently declare a license. Please contact the authors
|
| 69 |
-
for permitted uses.
|
|
|
|
| 8 |
- bimamba
|
| 9 |
---
|
| 10 |
|
| 11 |
+
<h1 align="center">πΈ FlowerDance</h1>
|
| 12 |
+
<h3 align="center">MeanFlow for Efficient and Refined 3D Dance Generation</h3>
|
| 13 |
+
|
| 14 |
+
<p align="center">
|
| 15 |
+
<a href="https://arxiv.org/abs/2511.21029">
|
| 16 |
+
<img src="https://img.shields.io/badge/arXiv-FlowerDance-green" alt="Paper">
|
| 17 |
+
</a>
|
| 18 |
+
<a href="https://sun-happy-ykx.github.io/FlowerDance/">
|
| 19 |
+
<img src="https://img.shields.io/badge/Project_Page-FlowerDance-blue" alt="Project Page">
|
| 20 |
+
</a>
|
| 21 |
+
<a href="#code">
|
| 22 |
+
<img src="https://img.shields.io/badge/Conference-ECCV%202026-orange" alt="Conference">
|
| 23 |
+
</a>
|
| 24 |
+
</p>
|
| 25 |
+
|
| 26 |
+
<p align="center">
|
| 27 |
+
<img src="./flowerteaser.png" width="90%" alt="FlowerDance teaser">
|
| 28 |
+
</p>
|
| 29 |
+
|
| 30 |
+
> **Abstract**: Music-to-dance generation translates auditory signals into expressive human motion, yet existing approaches still struggle to balance refined 3D motion quality with strict inference budgets. FlowerDance is designed for both physically plausible, artistically expressive motion and efficient generation in speed and memory usage.
|
| 31 |
+
>
|
| 32 |
+
> FlowerDance combines MeanFlow with Physical Consistency Constraints for high-quality few-step sampling, and uses a lightweight non-autoregressive BiMamba backbone with Channel-Level Fusion for long-horizon music-to-dance synthesis. It also supports motion editing through time-decayed soft masking, enabling users to refine generated dance sequences interactively.
|
| 33 |
+
|
| 34 |
+
π **FlowerDance has been accepted to ECCV 2026!**
|
| 35 |
+
β¨ Training code release! β¨
|
| 36 |
|
| 37 |
+
---
|
| 38 |
+
|
| 39 |
+
<a id="code"></a>
|
| 40 |
+
|
| 41 |
+
## π Code
|
| 42 |
|
| 43 |
+
### π οΈ Set up the Environment
|
| 44 |
|
| 45 |
+
To set up the necessary environment for running this project, follow the steps below:
|
|
|
|
|
|
|
| 46 |
|
| 47 |
+
1. **Create a new conda environment**
|
| 48 |
|
| 49 |
+
```bash
|
| 50 |
+
conda create -n Flower_env python=3.10
|
| 51 |
+
conda activate Flower_env
|
| 52 |
+
```
|
| 53 |
|
| 54 |
+
2. **Install PyTorch (CUDA 12.8)**
|
| 55 |
|
| 56 |
+
```
|
| 57 |
+
pip install torch==2.7.1+cu128 torchvision==0.22.1+cu128 torchaudio==2.7.1+cu128 \
|
| 58 |
+
--index-url https://download.pytorch.org/whl/cu128
|
| 59 |
+
```
|
| 60 |
+
|
| 61 |
+
3. **Install remaining dependencies**
|
| 62 |
|
| 63 |
+
```bash
|
| 64 |
+
pip install -r requirements.txt
|
| 65 |
+
```
|
| 66 |
|
| 67 |
+
---
|
| 68 |
+
|
| 69 |
+
## π¦ Download Resources
|
| 70 |
|
| 71 |
+
- Download the **Preprocessed feature** from [Google Drive](https://drive.google.com/file/d/1UfCsOYMRsJAsH1LOxrJg8X5o3MRAwM2s/view?usp=sharing) and place them into `./data/` folder.
|
| 72 |
+
- Download the **Checkpoints for evaluation** and place them into the `./runs/` folder:
|
| 73 |
+
[Download Link](https://drive.google.com/file/d/1zZs_sXJToD5UzOA_m_DEoC0M79rEnEkg/view?usp=sharing)
|
| 74 |
+
|
| 75 |
+
---
|
| 76 |
+
|
| 77 |
+
## π§© Directory Structure
|
| 78 |
+
|
| 79 |
+
After downloading the necessary files, ensure the directory structure follows the pattern below:
|
| 80 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 81 |
```
|
| 82 |
+
FlowerDance/
|
| 83 |
+
β
|
| 84 |
+
βββ data/
|
| 85 |
+
βββ dataset/
|
| 86 |
+
βββ model/
|
| 87 |
+
βββ runs/
|
| 88 |
+
βββ requirements.txt
|
| 89 |
+
βββ args.py
|
| 90 |
+
βββ EDGE.py
|
| 91 |
+
βββ inpaint.py
|
| 92 |
+
βββ test.py
|
| 93 |
+
βββ vis.py
|
| 94 |
+
```
|
| 95 |
+
---
|
| 96 |
|
| 97 |
+
## ποΈ Training
|
|
|
|
| 98 |
|
| 99 |
+
```bash
|
| 100 |
+
export WANDB_MODE=offline
|
| 101 |
+
accelerate launch train.py --batch_size 128 --epochs 4000 --feature_type baseline
|
| 102 |
```
|
| 103 |
+
---
|
| 104 |
+
|
| 105 |
+
## π Evaluation
|
| 106 |
+
|
| 107 |
+
### π§ͺ Evaluate the Model
|
| 108 |
+
|
| 109 |
+
To evaluate the our modelβs performance:
|
| 110 |
+
|
| 111 |
+
```bash
|
| 112 |
+
python test.py --batch_size 128
|
| 113 |
+
```
|
| 114 |
+
|
| 115 |
|
| 116 |
+
---
|
| 117 |
|
| 118 |
+
## π Citation
|
| 119 |
|
| 120 |
```bibtex
|
| 121 |
+
@article{yang2025flowerdance,
|
| 122 |
title={FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generation},
|
| 123 |
author={Kaixing Yang and Xulong Tang and Ziqiao Peng and Xiangyue Zhang and Puwei Wang and Jun He and Hongyan Liu},
|
| 124 |
+
journal={arXiv preprint arXiv:2511.21029},
|
| 125 |
+
year={2025}
|
| 126 |
}
|
| 127 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
flowerteaser.png
ADDED
|
Git LFS Details
|