Add model card for FlashMotion

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-to-video
3
+ license: other
4
+ ---
5
+
6
+ # FlashMotion: Few-Step Controllable Video Generation with Trajectory Guidance
7
+
8
+ FlashMotion is a novel training framework designed for few-step trajectory-controllable video generation. It enables precise motion control along predefined trajectories while significantly reducing the computational overhead and time redundancy typically associated with multi-step denoising processes.
9
+
10
+ [**Project Page**](https://quanhaol.github.io/flashmotion-site/) | [**Paper**](https://huggingface.co/papers/2603.12146) | [**GitHub**](https://github.com/quanhaol/FlashMotion) | [**FlashBench**](https://huggingface.co/datasets/quanhaol/FlashBench)
11
+
12
+ ## Abstract
13
+ Recent advances in trajectory-controllable video generation have achieved remarkable progress. However, existing methods rely on multi-step denoising, leading to substantial computational overhead. FlashMotion bridges this gap by introducing a three-stage training framework: training a trajectory adapter on a multi-step generator, distilling the generator into a few-step version (FastGenerator), and finally aligning the adapter with the few-step generator using a hybrid diffusion and adversarial objective.
14
+
15
+ ## Installation
16
+
17
+ ```bash
18
+ # Clone this repository.
19
+ git clone https://github.com/quanhaol/FlashMotion
20
+ cd FlashMotion
21
+
22
+ # Install requirements
23
+ conda create -n flashmotion python=3.10 -y
24
+ conda activate flashmotion
25
+ pip install -r requirements.txt
26
+ pip install flash-attn --no-build-isolation
27
+ python setup.py develop
28
+ ```
29
+
30
+ ## Sample Usage
31
+
32
+ FlashMotion supports trajectory-controllable video generation using two types of adapters: ResNet and ControlNet. You can run the provided demo scripts for inference:
33
+
34
+ ```bash
35
+ # Inference using the ControlNet FastAdapter
36
+ bash running_scripts/inference/i2v_control_fewstep_controlnet.sh
37
+
38
+ # Inference using the ResNet FastAdapter
39
+ bash running_scripts/inference/i2v_control_fewstep_resnet.sh
40
+ ```
41
+
42
+ You can customize the generation by modifying the `--prompt`, `--image`, and `--trajectory` arguments within the scripts.
43
+
44
+ ## Citation
45
+
46
+ ```bibtex
47
+ @misc{li2026flashmotionfewstepcontrollablevideo,
48
+ title={FlashMotion: Few-Step Controllable Video Generation with Trajectory Guidance},
49
+ author={Quanhao Li and Zhen Xing and Rui Wang and Haidong Cao and Qi Dai and Daoguo Dong and Zuxuan Wu},
50
+ year={2026},
51
+ eprint={2603.12146},
52
+ archivePrefix={arXiv},
53
+ primaryClass={cs.CV},
54
+ url={https://arxiv.org/abs/2603.12146},
55
+ }
56
+ ```