xlt99 commited on
Commit
64ca643
Β·
verified Β·
1 Parent(s): ab69c77

Sync model card with GitHub README

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +94 -36
  3. flowerteaser.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ flowerteaser.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -8,62 +8,120 @@ tags:
8
  - bimamba
9
  ---
10
 
11
- # FlowerDance
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
 
13
- ## MeanFlow for Efficient and Refined 3D Dance Generation
 
 
 
 
14
 
15
- **Accepted to ECCV 2026**
16
 
17
- [Paper](https://arxiv.org/abs/2511.21029) |
18
- [Project Page](https://sun-happy-ykx.github.io/FlowerDance/) |
19
- [GitHub](https://github.com/XulongT/FlowerDance)
20
 
21
- ![FlowerDance teaser](https://raw.githubusercontent.com/XulongT/FlowerDance/main/flowerteaser.png)
22
 
23
- FlowerDance generates physically plausible and artistically expressive 3D dance
24
- with efficient inference and memory usage. It combines MeanFlow with Physical
25
- Consistency Constraints for high-quality few-step sampling and uses a
26
- lightweight, non-autoregressive BiMamba backbone with Channel-Level Fusion.
27
 
28
- ## Checkpoint
29
 
30
- This repository provides the evaluation checkpoint released with FlowerDance:
 
 
 
 
 
31
 
32
- - `train-3700.pt`
 
 
33
 
34
- Download it with:
 
 
35
 
36
- ```python
37
- from huggingface_hub import hf_hub_download
 
 
 
 
 
 
 
38
 
39
- checkpoint_path = hf_hub_download(
40
- repo_id="xlt99/FlowerDance",
41
- filename="train-3700.pt",
42
- )
43
- print(checkpoint_path)
44
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
 
46
- To use the checkpoint with the
47
- [official code](https://github.com/XulongT/FlowerDance), place it at:
48
 
49
- ```text
50
- runs/train/uniform2/weights/train-3700.pt
 
51
  ```
 
 
 
 
 
 
 
 
 
 
 
 
52
 
53
- Then follow the evaluation instructions in the GitHub README.
54
 
55
- ## Citation
56
 
57
  ```bibtex
58
- @inproceedings{yang2026flowerdance,
59
  title={FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generation},
60
  author={Kaixing Yang and Xulong Tang and Ziqiao Peng and Xiangyue Zhang and Puwei Wang and Jun He and Hongyan Liu},
61
- booktitle={European Conference on Computer Vision (ECCV)},
62
- year={2026}
63
  }
64
  ```
65
-
66
- ## License
67
-
68
- The release does not currently declare a license. Please contact the authors
69
- for permitted uses.
 
8
  - bimamba
9
  ---
10
 
11
+ <h1 align="center">🌸 FlowerDance</h1>
12
+ <h3 align="center">MeanFlow for Efficient and Refined 3D Dance Generation</h3>
13
+
14
+ <p align="center">
15
+ <a href="https://arxiv.org/abs/2511.21029">
16
+ <img src="https://img.shields.io/badge/arXiv-FlowerDance-green" alt="Paper">
17
+ </a>
18
+ <a href="https://sun-happy-ykx.github.io/FlowerDance/">
19
+ <img src="https://img.shields.io/badge/Project_Page-FlowerDance-blue" alt="Project Page">
20
+ </a>
21
+ <a href="#code">
22
+ <img src="https://img.shields.io/badge/Conference-ECCV%202026-orange" alt="Conference">
23
+ </a>
24
+ </p>
25
+
26
+ <p align="center">
27
+ <img src="./flowerteaser.png" width="90%" alt="FlowerDance teaser">
28
+ </p>
29
+
30
+ > **Abstract**: Music-to-dance generation translates auditory signals into expressive human motion, yet existing approaches still struggle to balance refined 3D motion quality with strict inference budgets. FlowerDance is designed for both physically plausible, artistically expressive motion and efficient generation in speed and memory usage.
31
+ >
32
+ > FlowerDance combines MeanFlow with Physical Consistency Constraints for high-quality few-step sampling, and uses a lightweight non-autoregressive BiMamba backbone with Channel-Level Fusion for long-horizon music-to-dance synthesis. It also supports motion editing through time-decayed soft masking, enabling users to refine generated dance sequences interactively.
33
+
34
+ πŸŽ‰ **FlowerDance has been accepted to ECCV 2026!**
35
+ ✨ Training code release! ✨
36
 
37
+ ---
38
+
39
+ <a id="code"></a>
40
+
41
+ ## πŸš€ Code
42
 
43
+ ### πŸ› οΈ Set up the Environment
44
 
45
+ To set up the necessary environment for running this project, follow the steps below:
 
 
46
 
47
+ 1. **Create a new conda environment**
48
 
49
+ ```bash
50
+ conda create -n Flower_env python=3.10
51
+ conda activate Flower_env
52
+ ```
53
 
54
+ 2. **Install PyTorch (CUDA 12.8)**
55
 
56
+ ```
57
+ pip install torch==2.7.1+cu128 torchvision==0.22.1+cu128 torchaudio==2.7.1+cu128 \
58
+ --index-url https://download.pytorch.org/whl/cu128
59
+ ```
60
+
61
+ 3. **Install remaining dependencies**
62
 
63
+ ```bash
64
+ pip install -r requirements.txt
65
+ ```
66
 
67
+ ---
68
+
69
+ ## πŸ“¦ Download Resources
70
 
71
+ - Download the **Preprocessed feature** from [Google Drive](https://drive.google.com/file/d/1UfCsOYMRsJAsH1LOxrJg8X5o3MRAwM2s/view?usp=sharing) and place them into `./data/` folder.
72
+ - Download the **Checkpoints for evaluation** and place them into the `./runs/` folder:
73
+ [Download Link](https://drive.google.com/file/d/1zZs_sXJToD5UzOA_m_DEoC0M79rEnEkg/view?usp=sharing)
74
+
75
+ ---
76
+
77
+ ## 🧩 Directory Structure
78
+
79
+ After downloading the necessary files, ensure the directory structure follows the pattern below:
80
 
 
 
 
 
 
81
  ```
82
+ FlowerDance/
83
+ β”‚
84
+ β”œβ”€β”€ data/
85
+ β”œβ”€β”€ dataset/
86
+ β”œβ”€β”€ model/
87
+ β”œβ”€β”€ runs/
88
+ β”œβ”€β”€ requirements.txt
89
+ β”œβ”€β”€ args.py
90
+ β”œβ”€β”€ EDGE.py
91
+ β”œβ”€β”€ inpaint.py
92
+ β”œβ”€β”€ test.py
93
+ └── vis.py
94
+ ```
95
+ ---
96
 
97
+ ## πŸ‹οΈ Training
 
98
 
99
+ ```bash
100
+ export WANDB_MODE=offline
101
+ accelerate launch train.py --batch_size 128 --epochs 4000 --feature_type baseline
102
  ```
103
+ ---
104
+
105
+ ## πŸ“ Evaluation
106
+
107
+ ### πŸ§ͺ Evaluate the Model
108
+
109
+ To evaluate the our model’s performance:
110
+
111
+ ```bash
112
+ python test.py --batch_size 128
113
+ ```
114
+
115
 
116
+ ---
117
 
118
+ ## πŸ“„ Citation
119
 
120
  ```bibtex
121
+ @article{yang2025flowerdance,
122
  title={FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generation},
123
  author={Kaixing Yang and Xulong Tang and Ziqiao Peng and Xiangyue Zhang and Puwei Wang and Jun He and Hongyan Liu},
124
+ journal={arXiv preprint arXiv:2511.21029},
125
+ year={2025}
126
  }
127
  ```
 
 
 
 
 
flowerteaser.png ADDED

Git LFS Details

  • SHA256: 6ba4e1fe6e40f73831d7b6e5bb52a79e096fb93876df0661de5074b57ad4f6aa
  • Pointer size: 131 Bytes
  • Size of remote file: 407 kB