nielsr HF Staff commited on
Commit
bcf4c0b
·
verified ·
1 Parent(s): a50fa48

Add model card for FlashMotion

Browse files

Hi! I'm Niels from the Hugging Face community science team. I noticed this repository was missing a model card, so I've opened this PR to add one.

This model card includes:
- A link to the research paper on Hugging Face.
- Links to the project page and GitHub repository.
- A summary of the FlashMotion framework.
- Installation and inference instructions based on the repository documentation.
- The appropriate pipeline tag for better discoverability on the Hub.

Documentation like this helps other researchers and developers understand and build upon your work.

Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-to-video
3
+ license: other
4
+ ---
5
+
6
+ # FlashMotion: Few-Step Controllable Video Generation with Trajectory Guidance
7
+
8
+ FlashMotion is a novel training framework designed for few-step trajectory-controllable video generation. It enables precise motion control along predefined trajectories while significantly reducing the computational overhead and time redundancy typically associated with multi-step denoising processes.
9
+
10
+ [**Project Page**](https://quanhaol.github.io/flashmotion-site/) | [**Paper**](https://huggingface.co/papers/2603.12146) | [**GitHub**](https://github.com/quanhaol/FlashMotion) | [**FlashBench**](https://huggingface.co/datasets/quanhaol/FlashBench)
11
+
12
+ ## Abstract
13
+ Recent advances in trajectory-controllable video generation have achieved remarkable progress. However, existing methods rely on multi-step denoising, leading to substantial computational overhead. FlashMotion bridges this gap by introducing a three-stage training framework: training a trajectory adapter on a multi-step generator, distilling the generator into a few-step version (FastGenerator), and finally aligning the adapter with the few-step generator using a hybrid diffusion and adversarial objective.
14
+
15
+ ## Installation
16
+
17
+ ```bash
18
+ # Clone this repository.
19
+ git clone https://github.com/quanhaol/FlashMotion
20
+ cd FlashMotion
21
+
22
+ # Install requirements
23
+ conda create -n flashmotion python=3.10 -y
24
+ conda activate flashmotion
25
+ pip install -r requirements.txt
26
+ pip install flash-attn --no-build-isolation
27
+ python setup.py develop
28
+ ```
29
+
30
+ ## Sample Usage
31
+
32
+ FlashMotion supports trajectory-controllable video generation using two types of adapters: ResNet and ControlNet. You can run the provided demo scripts for inference:
33
+
34
+ ```bash
35
+ # Inference using the ControlNet FastAdapter
36
+ bash running_scripts/inference/i2v_control_fewstep_controlnet.sh
37
+
38
+ # Inference using the ResNet FastAdapter
39
+ bash running_scripts/inference/i2v_control_fewstep_resnet.sh
40
+ ```
41
+
42
+ You can customize the generation by modifying the `--prompt`, `--image`, and `--trajectory` arguments within the scripts.
43
+
44
+ ## Citation
45
+
46
+ ```bibtex
47
+ @misc{li2026flashmotionfewstepcontrollablevideo,
48
+ title={FlashMotion: Few-Step Controllable Video Generation with Trajectory Guidance},
49
+ author={Quanhao Li and Zhen Xing and Rui Wang and Haidong Cao and Qi Dai and Daoguo Dong and Zuxuan Wu},
50
+ year={2026},
51
+ eprint={2603.12146},
52
+ archivePrefix={arXiv},
53
+ primaryClass={cs.CV},
54
+ url={https://arxiv.org/abs/2603.12146},
55
+ }
56
+ ```