htdong commited on
Commit
a5a31d6
·
verified ·
1 Parent(s): 6aedf77

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +165 -1
README.md CHANGED
@@ -9,4 +9,168 @@ tags:
9
  - RGBA
10
  - video
11
  - generation
12
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - RGBA
10
  - video
11
  - generation
12
+ ---
13
+
14
+ <div align="center">
15
+
16
+ <h1>
17
+ <img src="assets/loopy-logo.apng" alt="Loopy logo" height="32" style="vertical-align: middle; margin-right: 8px;"/>
18
+ Loopy
19
+ </h1>
20
+
21
+ <h3>Seamless Video Loop Generation via Anchored Looping Shift of Positional Embedding</h3>
22
+
23
+ [![arXiv](https://img.shields.io/badge/arXiv-XXXX.XXXXX-red)](https://arxiv.org/abs/XXXX.XXXXX)
24
+ [![Project Page](https://img.shields.io/badge/Project_Page-Link-green)](https://donghaotian123.github.io/Loopy/)
25
+ [![🤗 HuggingFace](https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-orange)](https://huggingface.co/htdong/Loopy)
26
+
27
+ </div>
28
+
29
+ <img src="assets/teaser.png" alt="Loopy Qualitative Results" style="max-width: 100%; height: auto;">
30
+
31
+ >Our **Loopy** generates high-quality looping videos with seamless transitions at loop boundaries and diverse motion. It also supports RGBA with semi-transparent effects. In the application block, all elements—including game assets and Loopy character stickers—are generated by our **Loopy**.
32
+
33
+ ---
34
+
35
+ ### 🔥 News
36
+ * **[2026.8.24]** Released Loopy, the Wan2.2-T2V-A14B–adapted weights and inference code are now open-sourced.
37
+ * **[2026.8.24]** Our technical report is available on [arXiv](https://arxiv.org/abs/XXXX.XXXXX).
38
+
39
+ ---
40
+
41
+ ### 📝 To-Do List
42
+
43
+ - [x] **Paper**: Release the technical report on arXiv.
44
+ - [x] **Inference Code**: Released the looping inference pipeline for Loopy.
45
+ - [x] **Model Weights**: Release the high-noise / low-noise LoRA checkpoints.
46
+
47
+ ---
48
+ ### 🌟 Showcase
49
+
50
+ ##### Seamless Looping Video Generation
51
+
52
+ <!-- | Prompt | Preview Video | Alpha Video |
53
+ | :---: | :---: | :---: |
54
+ | "Medium shot. A little girl holds a bubble wand and blows out colorful bubbles that float and pop in the air. The background of this video is transparent. Realistic style." |
55
+ <div style="display: flex; gap: 10px;">
56
+ <img src="girl.gif" alt="..." style="flex: 1; min-width: 200px;">
57
+ </div> |
58
+ <div style="display: flex; gap: 10px;">
59
+ <img src="girl_pha.gif" alt="..." style="flex: 1; min-width: 200px;">
60
+ </div> | -->
61
+ | Preview Video | Preview Video |
62
+ | :---: | :---: |
63
+ | <img src="assets/human.apng" width="320" height="180" style="object-fit:contain; display:block; margin:auto;"/> | <img src="assets/loopy-6.apng" width="320" height="180" style="object-fit:contain; display:block; margin:auto;"/> |
64
+
65
+ ##### For more results, please visit [Our Website](https://donghaotian123.github.io/Loopy/)
66
+
67
+ ### 🚀 Quick Start
68
+
69
+ ##### 1. Environment Setup
70
+
71
+ ```bash
72
+ # Clone the project repository
73
+ git clone https://github.com/WeChatCV/Loopy.git
74
+ cd Loopy
75
+
76
+ # Create and activate Conda environment
77
+ conda create -n Loopy python=3.11 -y
78
+ conda activate Loopy
79
+
80
+ # Install dependencies
81
+ pip install -r requirements.txt
82
+ ```
83
+
84
+ ##### 2. Model Download
85
+
86
+ Download [Wan2.2-T2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B)
87
+
88
+ Download the LightX2V 4-step distillation LoRAs for both experts:
89
+ [high noise](https://huggingface.co/lightx2v/Wan2.2-Distill-Loras/blob/main/wan2.2_t2v_A14b_high_noise_lora_rank64_lightx2v_4step_1217.safetensors) /
90
+ [low noise](https://huggingface.co/lightx2v/Wan2.2-Distill-Loras/blob/main/wan2.2_t2v_A14b_low_noise_lora_rank64_lightx2v_4step_1217.safetensors)
91
+
92
+ Download [Loopy](https://huggingface.co/htdong/Loopy) (`high_noise.safetensors` and
93
+ `low_noise.safetensors`)
94
+
95
+ ---
96
+
97
+ ### 🧪 Usage
98
+
99
+ Write one prompt per line in a plain UTF-8 text file, then launch the batch inference:
100
+
101
+ ```bash
102
+ output_path="./checkpoints"
103
+ mkdir -p $output_path
104
+
105
+ torchrun --nproc_per_node=8 generate_2.2_new.py --task t2v-A14B --size 832*480 \
106
+ --ckpt_dir Wan-AI/Wan2.2-T2V-A14B \
107
+ --dit_fsdp --t5_fsdp --ulysses_size 8 \
108
+ --frame_num 53 \
109
+ --sample_steps 4 \
110
+ --high_lightx2v_path "wan2.2_lora/wan2.2_t2v_A14b_high_noise_lora_rank64_lightx2v_4step_1217.safetensors" \
111
+ --low_lightx2v_path "wan2.2_lora/wan2.2_t2v_A14b_low_noise_lora_rank64_lightx2v_4step_1217.safetensors" \
112
+ --high_lora_path high_noise.safetensors \
113
+ --low_lora_path low_noise.safetensors \
114
+ --prompt_file prompt.txt \
115
+ --output_dir $output_path/results 2>&1 | tee -a $output_path/results.log
116
+
117
+ ```
118
+
119
+ Or simply run the packaged script after editing the paths inside it:
120
+
121
+ ```bash
122
+ bash test.sh
123
+ ```
124
+
125
+ You can specify the weights of `Wan2.2-T2V-A14B` with `--ckpt_dir`, the LightX2V distillation
126
+ LoRAs with `--high_lightx2v_path` / `--low_lightx2v_path`, and the Loopy LoRAs with
127
+ `--high_lora_path` / `--low_lora_path`. Wan2.2-T2V-A14B is a two-expert MoE model, so the
128
+ high-noise and low-noise branches each need their own pair of LoRAs.
129
+
130
+ Generated videos are written to `--output_dir`, one subdirectory per prompt, each containing
131
+ `fgr.mp4`.
132
+
133
+
134
+
135
+ **Prompt Writing Tip:** Describe a subject whose motion is naturally periodic or continuous —
136
+ falling snow, drifting clouds, flowing water, a walking animal, a rotating object. State the
137
+ visual style and the shot type (close-up, medium shot, wide shot) as well. Prompts support
138
+ both Chinese and English input.
139
+
140
+ ```bash
141
+ # An example of prompt.
142
+ An Arctic fox leaps nimbly through the snow while hunting, its white fur blending seamlessly with the snowflakes. Realistic style; a scene of winter wildlife.
143
+ ```
144
+
145
+ ---
146
+
147
+ ### 🤝 Acknowledgements
148
+
149
+ This project is built upon the following excellent open-source projects:
150
+ * [Wan2.2](https://github.com/Wan-Video/Wan2.2) (base video generation model)
151
+ * [LightX2V](https://github.com/ModelTC/LightX2V) (inference acceleration)
152
+ * [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio) (training/inference framework)
153
+
154
+ We sincerely thank the authors and contributors of these projects.
155
+
156
+ ---
157
+
158
+ ### ✏️ Citation
159
+
160
+ If you find our work helpful for your research, please consider citing our paper:
161
+
162
+ ```bibtex
163
+ @article{haotiandong2026loopy,
164
+ title = {Loopy: Seamless Video Loop Generation via Anchored Looping Shift of Positional Embedding},
165
+ author = {Haotian Dong, Wenjing Wang, Chen Li, Jing Lyu, Xin Wang, Di Lin},
166
+ journal = {arXiv preprint},
167
+ year = {2026}
168
+ }
169
+ ```
170
+
171
+ ---
172
+
173
+ ### 📬 Contact Us
174
+
175
+ If you have any questions or suggestions, feel free to reach out via
176
+ [GitHub Issues](https://github.com/WeChatCV/Loopy/issues). We look forward to your feedback!