Text-to-Video
Diffusers
English
nielsr HF Staff commited on
Commit
338610c
·
verified ·
1 Parent(s): 1977c3f

Add library_name and improve model card documentation

Browse files

Hi! I'm Niels from the Hugging Face community team. I noticed this model has excellent documentation and evidence of compatibility with the `diffusers` library.

I've opened this PR to:
1. Add `library_name: diffusers` to the metadata to enable the "Use in Diffusers" button and improve discoverability.
2. Update the `pipeline_tag` to `other` as requested.
3. Include a "Sample Usage" section featuring the official `diffusers` code snippet for easier onboarding.
4. Add a direct link to the paper at the top of the description.

Files changed (1) hide show
  1. README.md +41 -284
README.md CHANGED
@@ -1,10 +1,11 @@
1
  ---
2
- license: apache-2.0
3
- language:
4
- - en
5
  base_model:
6
  - Wan-AI/Wan2.1-T2V-14B-Diffusers
7
- pipeline_tag: text-to-video
 
 
 
 
8
  base_model_relation: finetune
9
  ---
10
 
@@ -16,6 +17,8 @@ base_model_relation: finetune
16
 
17
  <h5 align="center">⭐ 14B Real-Time Long Video Generation Model can be Cheaper, Faster but Keep Stronger than 1.3B ones ⭐</h5>
18
 
 
 
19
  <h5 align="center">
20
 
21
  [![arXiv](https://img.shields.io/badge/arXiv-2603.04379-b31b1b.svg?logo=arxiv)](https://arxiv.org/abs/2603.04379)
@@ -32,10 +35,6 @@ base_model_relation: finetune
32
  [![vLLM-Omni](https://img.shields.io/badge/Backend-vLLM--Omni-orange)](https://github.com/vllm-project/vllm-omni/pull/1604)
33
  [![SGLang Diffusion](https://img.shields.io/badge/Backend-SGLang--Diffusion-yellow)](https://github.com/sgl-project/sglang/pull/19782)
34
 
35
-
36
-
37
-
38
-
39
  </h5>
40
 
41
  <div align="center">
@@ -46,302 +45,60 @@ This repository is the official implementation of Helios, which is a breakthroug
46
 
47
  ## ✨ Highlights
48
 
49
-
50
  1. **Without commonly used anti-drifting strategies** (e.g., self-forcing, error-banks, keyframe sampling, or inverted sampling), Helios generates minute-scale videos with high quality and strong coherence.
51
 
52
  2. **Without standard acceleration techniques** (e.g., KV-cache, causal masking, sparse/linear attention, TinyVAE, progressive noise schedules, hidden-state caching, or quantization), Helios achieves 19.5 FPS in end-to-end inference on a single H100 GPU.
53
 
54
  3. **We introduce optimizations that improve both training and inference throughput while reducing memory consumption,** enabling image-diffusion-scale batch sizes during training while fitting up to four 14B models within 80 GB of GPU memory.
55
 
 
56
 
 
 
 
 
57
 
58
- ## 🎬 Video Demos
59
-
60
- <!-- <div align="center">
61
- <video src="https://github.com/PKU-YuanGroup/Helios-Page/blob/main/videos/helios_features.mp4?raw=true" width="70%" controls="controls" poster=""></video>
62
- </div>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
63
 
64
- or you can click <a href="https://www.youtube.com/watch?v=vd_AgHtOUFQ">here</a> to get the video. Some best prompts are [here](./example/prompt.txt). -->
65
 
66
  [![Demo Video of Helios](https://github.com/user-attachments/assets/1d10da4a-aba9-4ac1-ab02-cd0dfce8d35b)](https://www.youtube.com/watch?v=vd_AgHtOUFQ)
67
  or you can click <a href="https://github.com/PKU-YuanGroup/Helios-Page/blob/main/videos/helios_features.mp4">here</a> to get the video. Some best prompts are [here](./example/prompt.txt).
68
 
69
-
70
  ## 📣 Latest News!!
71
 
72
  * `[2026.03.04]` 👋 We are excited to announce the release of the Helios [technical report](https://arxiv.org/abs/2603.04379) on arXiv. We welcome discussions and feedback!
73
  * `[2026.03.04]` 🚀 Day-0 support for [Ascend-NPU](https://www.hiascend.com),with sincere gratitude to the Ascend Team for their support.
74
  * `[2026.03.04]` 🚀 Day-0 support for [Diffusers](https://github.com/huggingface/diffusers/pull/13208),with special thanks to the HuggingFace Team for their support.
75
- * `[2026.03.04]` 🚀 Day-0 support for [vLLM-Omni](https://github.com/vllm-project/vllm-omni/pull/1604),with heartfelt gratitude to the vLLM Team for their support.
76
- * `[2026.03.04]` 🚀 Day-0 support for [SGLang-Diffusion](https://github.com/sgl-project/sglang/pull/19782),with huge thanks to the SGLang Team for their support.
77
  * `[2026.03.04]` 🔥 We've released the training/inference code and weights of **Helios-Base**, **Helios-Mid** and **Helios-Distilled**.
78
 
79
-
80
- ## 🔥 Friendly Links
81
-
82
- If your work has improved **Helios** and you would like more people to see it, please inform us.
83
-
84
- * [Ascend-NPU](https://www.hiascend.com/): Developed by Huawei, this hardware is designed for efficient AI model training and inference, boosting performance in tasks like computer vision, natural language processing, and autonomous driving.
85
- * [Diffusers](https://github.com/huggingface/diffusers): A popular library designed for working with diffusion models and other generative models in deep learning. It supports easy integration and manipulation of a wide range of generative models.
86
- * [vLLM-Omni](https://github.com/vllm-project/vllm-omni): A fully disaggregated serving system for any-to-any models. vLLM-Omni breaks complex architectures into a stage-based graph, using a decoupled backend to maximize resource efficiency and throughput.
87
- * [SGLang-Diffusion](https://github.com/sgl-project/sglang): An inference framework for accelerated image and video generation using diffusion models. It provides an end-to-end unified pipeline with optimized kernels and an efficient scheduler loop.
88
-
89
-
90
-
91
- ### Model Download
92
-
93
- | Models | Download Link | Supports | Notes |
94
- |------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------|---------------------------------------------------------------------------------------------|
95
- | Helios-Base | 🤗 [Huggingface](https://huggingface.co/BestWishYsh/Helios-Base) 🤖 [ModelScope](https://modelscope.cn/models/BestWishYSH/Helios-Base) | T2V ✅ I2V ✅ V2V ✅ Interactive ✅ | Best Quality, with v-prediction, standard CFG and custom HeliosScheduler. |
96
- | Helios-Mid | 🤗 [Huggingface](https://huggingface.co/BestWishYsh/Helios-Mid) 🤖 [ModelScope](https://modelscope.cn/models/BestWishYSH/Helios-Mid) | T2V ✅ I2V ✅ V2V ✅ Interactive ✅ | Intermediate Ckpt, with v-prediction, CFG-Zero* and custom HeliosScheduler. |
97
- | Helios-Distilled | 🤗 [Huggingface](https://huggingface.co/BestWishYsh/Helios-Distilled) 🤖 [ModelScope](https://modelscope.cn/models/BestWishYSH/Helios-Distilled) | T2V ✅ I2V ✅ V2V ✅ Interactive ✅ | Best Efficiency, with x0-prediction and custom HeliosDMDScheduler. |
98
-
99
-
100
-
101
- > 💡Note:
102
- > * All three models share the same architecture, but Helios-Mid and Helios-Distilled use a more aggressive multi-scale sampling pipeline to achieve better efficiency.
103
- > * Helios-Mid is an intermediate checkpoint generated in the process of distilling Helios-Base into Helios-Distilled, and may not meet expected quality.
104
- > * For Image-to-Video or Video-to-Video, since training is based on Text-to-Video, these two functions may be slightly inferior to Text-to-Video. You may enable `is_skip_first_chunk` if you find the first few chunks are static.
105
-
106
-
107
- Download models using huggingface-cli:
108
- ``` sh
109
- pip install "huggingface_hub[cli]"
110
- huggingface-cli download BestWishYSH/Helios-Base --local-dir BestWishYSH/Helios-Base
111
- huggingface-cli download BestWishYSH/Helios-Mid --local-dir BestWishYSH/Helios-Mid
112
- huggingface-cli download BestWishYSH/Helios-Distilled --local-dir BestWishYSH/HeliosDistillede
113
- ```
114
-
115
- Download models using modelscope-cli:
116
- ``` sh
117
- pip install modelscope
118
- modelscope download BestWishYSH/Helios-Base --local_dir BestWishYSH/Helios-Base
119
- modelscope download BestWishYSH/Helios-Mid --local-dir BestWishYSH/Helios-Mid
120
- modelscope download BestWishYSH/Helios-Distilled --local-dir BestWishYSH/HeliosDistillede
121
- ```
122
-
123
-
124
- ## 🚀 Inference
125
-
126
-
127
- Helios uses an autoregressive approach that generates **33 frames per chunk**. For optimal performance, `num_frames` should be set to a multiple of `33`. If a non-multiple value is provided, it will be automatically rounded up to the nearest multiple of 33.
128
-
129
- **Example frame counts for different video lengths:**
130
-
131
- | num_frames | Adjusted Frames | 24 FPS | 16 FPS |
132
- |------------|-----------------|--------|--------|
133
- | 1449 | 1452 (33×44) | ~60s (1min) | ~90s (1min 30s) |
134
- | 720 | 726 (33×22) | ~30s | ~45s |
135
- | 240 | 264 (33×8) | ~11s | ~16s |
136
- | 129 | 132 (33×4) | ~5.5s | ~8s |
137
-
138
- ### Sanity Check
139
-
140
- Before trying your own inputs, we highly recommend going through the sanity check to find out if any hardware or software went wrong.
141
-
142
- | Task | **Helios-Base** | **Helios-Mid** | **Helios-Distilled** |
143
- | ------- | -------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------- |
144
- | **T2V** | <video src="https://github.com/user-attachments/assets/14e10753-0366-4790-ad8f-7b66d821ed11" controls width="240"></video> | <video src="https://github.com/user-attachments/assets/c1778691-a80b-428c-8094-88bb1dd1d52b" controls width="240"></video> | <video src="https://github.com/user-attachments/assets/4ca28c79-9dfa-49de-9c3a-f4c7b6c766cd" controls width="240"></video> |
145
- | **V2V** | <video src="https://github.com/user-attachments/assets/420cb572-85c2-42d8-98d7-37b0bc24c844" controls width="240"></video> | <video src="https://github.com/user-attachments/assets/7d703fa6-dc1a-4138-a897-e58cfd9236d6" controls width="240"></video> | <video src="https://github.com/user-attachments/assets/45329c55-1a25-459c-bbf0-4e584ec5b23d" controls width="240"></video> |
146
-
147
-
148
- ### ✨ Diffusers Pipeline
149
-
150
- Install diffusers from source:
151
- ```bash
152
- pip install git+https://github.com/huggingface/diffusers.git
153
- ```
154
-
155
- For example, let's take Helios-Distilled.
156
-
157
- <details>
158
- <summary>Click to expand the code</summary>
159
-
160
- ```bash
161
- import torch
162
- from diffusers import ModularPipeline, ClassifierFreeGuidance
163
- from diffusers.utils import export_to_video, load_image, load_video
164
-
165
- mod_pipe = ModularPipeline.from_pretrained("BestWishYsh/Helios-Distilled")
166
- mod_pipe.load_components(torch_dtype=torch.bfloat16)
167
- mod_pipe.to("cuda")
168
-
169
- # we need to upload guider to the model repo, so each checkpoint will be able to config their guidance differently
170
- guider = ClassifierFreeGuidance(guidance_scale=1.0)
171
- mod_pipe.update_components(guider=guider)
172
-
173
- # --- T2V ---
174
- print("=== T2V ===")
175
- prompt = (
176
- "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean. "
177
- "The fish has bright blue and yellow scales with a small, distinctive orange spot on its side, its fins moving "
178
- "fluidly. The coral reefs are alive with a variety of marine life, including small schools of colorful fish and "
179
- "sea turtles gliding by. The water is crystal clear, allowing for a view of the sandy ocean floor below. The reef "
180
- "itself is adorned with a mix of hard and soft corals in shades of red, orange, and green. The photo captures "
181
- "the fish from a slightly elevated angle, emphasizing its lively movements and the vivid colors of its surroundings. "
182
- "A close-up shot with dynamic movement."
183
- )
184
-
185
- output = mod_pipe(
186
- prompt=prompt,
187
- height=384,
188
- width=640,
189
- num_frames=240,
190
- pyramid_num_inference_steps_list=[2, 2, 2],
191
- is_amplify_first_chunk=True,
192
- generator=torch.Generator("cuda").manual_seed(42),
193
- output="videos",
194
- )
195
-
196
- export_to_video(output[0], "helios_distilled_modular_t2v_output.mp4", fps=24)
197
- print(f"T2V max memory: {torch.cuda.max_memory_allocated() / 1024**3:.3f} GB")
198
- torch.cuda.empty_cache()
199
- torch.cuda.reset_peak_memory_stats()
200
-
201
- # --- I2V ---
202
- print("=== I2V ===")
203
- image = load_image(
204
- "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/helios/wave.jpg"
205
- )
206
- i2v_prompt = (
207
- "A towering emerald wave surges forward, its crest curling with raw power and energy. "
208
- "Sunlight glints off the translucent water, illuminating the intricate textures and deep green hues within the wave's body."
209
- )
210
-
211
- output = mod_pipe(
212
- prompt=i2v_prompt,
213
- image=image,
214
- height=384,
215
- width=640,
216
- num_frames=240,
217
- pyramid_num_inference_steps_list=[2, 2, 2],
218
- is_amplify_first_chunk=True,
219
- generator=torch.Generator("cuda").manual_seed(42),
220
- output="videos",
221
- )
222
-
223
- export_to_video(output[0], "helios_distilled_modular_i2v_output.mp4", fps=24)
224
- print(f"I2V max memory: {torch.cuda.max_memory_allocated() / 1024**3:.3f} GB")
225
- torch.cuda.empty_cache()
226
- torch.cuda.reset_peak_memory_stats()
227
-
228
- # --- V2V ---
229
- print("=== V2V ===")
230
- video = load_video(
231
- "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/helios/car.mp4"
232
- )
233
- v2v_prompt = (
234
- "A dynamic time-lapse video showing the rapidly moving scenery from the window of a speeding train. "
235
- "The camera captures various elements such as lush green fields, towering trees, quaint countryside houses, "
236
- "and distant mountain ranges passing by quickly."
237
- )
238
-
239
- output = mod_pipe(
240
- prompt=v2v_prompt,
241
- video=video,
242
- height=384,
243
- width=640,
244
- num_frames=240,
245
- pyramid_num_inference_steps_list=[2, 2, 2],
246
- is_amplify_first_chunk=True,
247
- generator=torch.Generator("cuda").manual_seed(42),
248
- output="videos",
249
- )
250
-
251
- export_to_video(output[0], "helios_distilled_modular_v2v_output.mp4", fps=24)
252
- print(f"V2V max memory: {torch.cuda.max_memory_allocated() / 1024**3:.3f} GB")
253
- ```
254
-
255
- </details>
256
-
257
- ### ✨ vLLM-Omni Pipeline
258
-
259
- Install vllm-omni from source:
260
- ```bash
261
- pip install git+https://github.com/vllm-project/vllm-omni.git
262
- ```
263
-
264
- For example, let's take Text-to-Video.
265
-
266
- <details>
267
- <summary>Click to expand the code</summary>
268
-
269
- ```bash
270
- cd vllm-omni
271
-
272
- # Helios-Base
273
- python3 examples/offline_inference/helios/end2end.py \
274
- --sample-type t2v \
275
- --model ./Helios-Base \
276
- --prompt "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean. The fish has bright blue and yellow scales with a small, distinctive orange spot on its side, its fins moving fluidly. The coral reefs are alive with a variety of marine life, including small schools of colorful fish and sea turtles gliding by. The water is crystal clear, allowing for a view of the sandy ocean floor below. The reef itself is adorned with a mix of hard and soft corals in shades of red, orange, and green. The photo captures the fish from a slightly elevated angle, emphasizing its lively movements and the vivid colors of its surroundings. A close-up shot with dynamic movement." \
277
- --num-frames 99 \
278
- --seed 42 \
279
- --output helios_t2v_base.mp4
280
-
281
- # Helios-Mid
282
- python examples/offline_inference/helios/end2end.py \
283
- --model ./Helios-Mid --sample-type t2v \
284
- --prompt "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean. The fish has bright blue and yellow scales with a small, distinctive orange spot on its side, its fins moving fluidly. The coral reefs are alive with a variety of marine life, including small schools of colorful fish and sea turtles gliding by. The water is crystal clear, allowing for a view of the sandy ocean floor below. The reef itself is adorned with a mix of hard and soft corals in shades of red, orange, and green. The photo captures the fish from a slightly elevated angle, emphasizing its lively movements and the vivid colors of its surroundings. A close-up shot with dynamic movement." \
285
- --guidance-scale 5.0 --is-enable-stage2 \
286
- --pyramid-num-inference-steps-list 20 20 20 \
287
- --num-frames 99 \
288
- --use-cfg-zero-star --use-zero-init --zero-steps 1 \
289
- --output helios_t2v_mid.mp4
290
-
291
- # Helios-Distilled
292
- python examples/offline_inference/helios/end2end.py \
293
- --model ./Helios-Distilled --sample-type t2v \
294
- --prompt "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean. The fish has bright blue and yellow scales with a small, distinctive orange spot on its side, its fins moving fluidly. The coral reefs are alive with a variety of marine life, including small schools of colorful fish and sea turtles gliding by. The water is crystal clear, allowing for a view of the sandy ocean floor below. The reef itself is adorned with a mix of hard and soft corals in shades of red, orange, and green. The photo captures the fish from a slightly elevated angle, emphasizing its lively movements and the vivid colors of its surroundings. A close-up shot with dynamic movement." \
295
- --num-frames 240 --guidance-scale 1.0 --is-enable-stage2 \
296
- --pyramid-num-inference-steps-list 2 2 2 \
297
- --is-amplify-first-chunk --output helios_t2v_distilled.mp4
298
- ```
299
- </details>
300
-
301
- ### ✨ SGLang-Diffusion Pipeline
302
-
303
- Install sglang-diffusion from source:
304
- ```bash
305
- pip install git+https://github.com/sgl-project/sglang.git
306
- ```
307
-
308
- For example, let's take Helios-Base. **(Native Support)**
309
-
310
- <details>
311
- <summary>Click to expand the code</summary>
312
-
313
- ```bash
314
- sglang generate \
315
- --model-path BestWishYsh/Helios-Base \
316
- --prompt "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean. The fish has bright blue and yellow scales with a small, distinctive orange spot on its side, its fins moving fluidly. The coral reefs are alive with a variety of marine life, including small schools of colorful fish and sea turtles gliding by. The water is crystal clear, allowing for a view of the sandy ocean floor below. The reef itself is adorned with a mix of hard and soft corals in shades of red, orange, and green. The photo captures the fish from a slightly elevated angle, emphasizing its lively movements and the vivid colors of its surroundings. A close-up shot with dynamic movement." \
317
- --negative-prompt "Bright tones, overexposed, static, blurred details, subtitles, style, works, paintings, images, static, overall gray, worst quality, low quality, JPEG compression residue, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn faces, deformed, disfigured, misshapen limbs, fused fingers, still picture, messy background, three legs, many people in the background, walking backwards" \
318
- --height 384 \
319
- --width 640 \
320
- --num-frames 99 \
321
- --num-inference-steps 50 \
322
- --guidance-scale 5.0
323
- ```
324
- </details>
325
-
326
- For example, let's take Helios-Base. **(Diffusers Backend)**
327
-
328
- <details>
329
- <summary>Click to expand the code</summary>
330
-
331
- ```bash
332
- sglang generate \
333
- --model-path BestWishYsh/Helios-Base \
334
- --prompt "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean. The fish has bright blue and yellow scales with a small, distinctive orange spot on its side, its fins moving fluidly. The coral reefs are alive with a variety of marine life, including small schools of colorful fish and sea turtles gliding by. The water is crystal clear, allowing for a view of the sandy ocean floor below. The reef itself is adorned with a mix of hard and soft corals in shades of red, orange, and green. The photo captures the fish from a slightly elevated angle, emphasizing its lively movements and the vivid colors of its surroundings. A close-up shot with dynamic movement." \
335
- --negative-prompt "Bright tones, overexposed, static, blurred details, subtitles, style, works, paintings, images, static, overall gray, worst quality, low quality, JPEG compression residue, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn faces, deformed, disfigured, misshapen limbs, fused fingers, still picture, messy background, three legs, many people in the background, walking backwards" \
336
- --height 384 \
337
- --width 640 \
338
- --num-frames 99 \
339
- --num-inference-steps 50 \
340
- --guidance-scale 5.0 \
341
- --backend diffusers
342
- ```
343
- </details>
344
-
345
  ## 🙌 Description
346
 
347
  - **Repository:** [Code](https://github.com/PKU-YuanGroup/Helios), [Page](https://pku-yuangroup.github.io/Helios-Page/)
 
1
  ---
 
 
 
2
  base_model:
3
  - Wan-AI/Wan2.1-T2V-14B-Diffusers
4
+ language:
5
+ - en
6
+ license: apache-2.0
7
+ pipeline_tag: other
8
+ library_name: diffusers
9
  base_model_relation: finetune
10
  ---
11
 
 
17
 
18
  <h5 align="center">⭐ 14B Real-Time Long Video Generation Model can be Cheaper, Faster but Keep Stronger than 1.3B ones ⭐</h5>
19
 
20
+ This repository contains the weights for Helios, as presented in the paper [Helios: Real Real-Time Long Video Generation Model](https://huggingface.co/papers/2603.04379).
21
+
22
  <h5 align="center">
23
 
24
  [![arXiv](https://img.shields.io/badge/arXiv-2603.04379-b31b1b.svg?logo=arxiv)](https://arxiv.org/abs/2603.04379)
 
35
  [![vLLM-Omni](https://img.shields.io/badge/Backend-vLLM--Omni-orange)](https://github.com/vllm-project/vllm-omni/pull/1604)
36
  [![SGLang Diffusion](https://img.shields.io/badge/Backend-SGLang--Diffusion-yellow)](https://github.com/sgl-project/sglang/pull/19782)
37
 
 
 
 
 
38
  </h5>
39
 
40
  <div align="center">
 
45
 
46
  ## ✨ Highlights
47
 
 
48
  1. **Without commonly used anti-drifting strategies** (e.g., self-forcing, error-banks, keyframe sampling, or inverted sampling), Helios generates minute-scale videos with high quality and strong coherence.
49
 
50
  2. **Without standard acceleration techniques** (e.g., KV-cache, causal masking, sparse/linear attention, TinyVAE, progressive noise schedules, hidden-state caching, or quantization), Helios achieves 19.5 FPS in end-to-end inference on a single H100 GPU.
51
 
52
  3. **We introduce optimizations that improve both training and inference throughput while reducing memory consumption,** enabling image-diffusion-scale batch sizes during training while fitting up to four 14B models within 80 GB of GPU memory.
53
 
54
+ ## 🚀 Sample Usage (Diffusers)
55
 
56
+ Install diffusers from source:
57
+ ```bash
58
+ pip install git+https://github.com/huggingface/diffusers.git
59
+ ```
60
 
61
+ ```python
62
+ import torch
63
+ from diffusers import ModularPipeline, ClassifierFreeGuidance
64
+ from diffusers.utils import export_to_video
65
+
66
+ mod_pipe = ModularPipeline.from_pretrained("BestWishYsh/Helios-Distilled")
67
+ mod_pipe.load_components(torch_dtype=torch.bfloat16)
68
+ mod_pipe.to("cuda")
69
+
70
+ # Configure guidance
71
+ guider = ClassifierFreeGuidance(guidance_scale=1.0)
72
+ mod_pipe.update_components(guider=guider)
73
+
74
+ prompt = "A vibrant tropical fish swimming gracefully among colorful coral reefs in a clear, turquoise ocean."
75
+
76
+ output = mod_pipe(
77
+ prompt=prompt,
78
+ height=384,
79
+ width=640,
80
+ num_frames=240,
81
+ pyramid_num_inference_steps_list=[2, 2, 2],
82
+ is_amplify_first_chunk=True,
83
+ generator=torch.Generator("cuda").manual_seed(42),
84
+ output="videos",
85
+ )
86
+
87
+ export_to_video(output[0], "helios_distilled_output.mp4", fps=24)
88
+ ```
89
 
90
+ ## 🎬 Video Demos
91
 
92
  [![Demo Video of Helios](https://github.com/user-attachments/assets/1d10da4a-aba9-4ac1-ab02-cd0dfce8d35b)](https://www.youtube.com/watch?v=vd_AgHtOUFQ)
93
  or you can click <a href="https://github.com/PKU-YuanGroup/Helios-Page/blob/main/videos/helios_features.mp4">here</a> to get the video. Some best prompts are [here](./example/prompt.txt).
94
 
 
95
  ## 📣 Latest News!!
96
 
97
  * `[2026.03.04]` 👋 We are excited to announce the release of the Helios [technical report](https://arxiv.org/abs/2603.04379) on arXiv. We welcome discussions and feedback!
98
  * `[2026.03.04]` 🚀 Day-0 support for [Ascend-NPU](https://www.hiascend.com),with sincere gratitude to the Ascend Team for their support.
99
  * `[2026.03.04]` 🚀 Day-0 support for [Diffusers](https://github.com/huggingface/diffusers/pull/13208),with special thanks to the HuggingFace Team for their support.
 
 
100
  * `[2026.03.04]` 🔥 We've released the training/inference code and weights of **Helios-Base**, **Helios-Mid** and **Helios-Distilled**.
101
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
102
  ## 🙌 Description
103
 
104
  - **Repository:** [Code](https://github.com/PKU-YuanGroup/Helios), [Page](https://pku-yuangroup.github.io/Helios-Page/)