Instructions to use vanzl/DiffusionART-HunyuanVideo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use vanzl/DiffusionART-HunyuanVideo with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("vanzl/DiffusionART-HunyuanVideo", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 5,418 Bytes
517f658 c2ce1ca 517f658 c2ce1ca 517f658 c2ce1ca 517f658 c2ce1ca b9f83d8 c2ce1ca b9f83d8 76e8068 517f658 c2ce1ca b9f83d8 c2ce1ca b9f83d8 dadb17a c2ce1ca b9f83d8 c2ce1ca b9f83d8 c2ce1ca 517f658 06b4c62 c2ce1ca 06b4c62 c2ce1ca 06b4c62 dadb17a c2ce1ca 06b4c62 517f658 06b4c62 c2ce1ca 06b4c62 c2ce1ca 517f658 c2ce1ca dadb17a c2ce1ca dadb17a c2ce1ca dadb17a 7904853 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 | ---
license: other
license_name: tencent-hunyuan-community
license_link: https://huggingface.co/tencent/HunyuanVideo/blob/6204ad6aea1a77ff5aba337c88278bb9500eb37/LICENSE
base_model: hunyuanvideo-community/HunyuanVideo
pipeline_tag: text-to-video
tags:
- hunyuanvideo
- diffusionart
- arxiv:2610.12572
---
# DiffusionART 路 HunyuanVideo
[Paper](https://arxiv.org/abs/2610.12572) 路
[Code](https://github.com/vanzll/DiffusionART) 路
[Project Page](https://vanzll.github.io/diffusionart-project/) 路
[Demo](https://vanzll.github.io/diffusionart-project/demo.html)
HunyuanVideo-13B fine-tuned with **DiffusionART** for text-to-video generation.
This repository contains the **full transformer weights**, not a LoRA or a
complete pipeline. The inference entry below downloads the base model's VAE
and text encoders automatically.
## Inference
Use the included [infer.py](https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/blob/main/infer.py).
Expand the setup once, then run the example from the same directory.
<details>
<summary>Environment setup</summary>
Linux, Python 3.12, a CUDA 12.1-compatible driver and toolkit (`nvcc`), and
approximately 100 GiB of available GPU memory and disk space for the verified
default path. The installer uses a pinned public DanceGRPO inference runtime.
```bash
export RUN_DIR="${RUN_DIR:-$PWD/diffusionart-t2v-demo}"
export HF_HOME="$RUN_DIR/cache/hf"
export PIP_CACHE_DIR="$RUN_DIR/pip-cache"
export TMPDIR="$RUN_DIR/tmp"
export XDG_CACHE_HOME="$RUN_DIR/xdg-cache"
mkdir -p "$RUN_DIR" "$HF_HOME" "$PIP_CACHE_DIR" "$TMPDIR" "$XDG_CACHE_HOME"
cd "$RUN_DIR"
python3.12 -m venv bootstrap
bootstrap/bin/python -m pip install 'huggingface-hub==0.26.1'
bootstrap/bin/huggingface-cli login
bootstrap/bin/python - <<'PY'
from huggingface_hub import snapshot_download
snapshot_download(
"vanzl/DiffusionART-HunyuanVideo",
revision="b9f83d8fc677be078cf20e75e2149a5f69059220",
allow_patterns=["infer.py", "install.sh", "requirements-inference.txt"],
local_dir="release",
)
PY
bash release/install.sh "$RUN_DIR/venv" "$RUN_DIR/runtime"
```
The fixed revision preserves the released weights and inference entry.
Hugging Face login is used by that entry even though this model is public.
</details>
```bash
venv/bin/python - <<'PY'
import runpy
import sys
import torch
# Use the attention backend from the successful inference checks.
torch.backends.cuda.enable_cudnn_sdp(False)
sys.argv = [
"infer.py",
"--revision", "b9f83d8fc677be078cf20e75e2149a5f69059220",
"--prompt", "A white horse gallops through shallow water along a sunlit beach.",
"--output", "diffusionart.mp4",
"--cache-dir", "cache",
]
runpy.run_path("release/infer.py", run_name="__main__")
PY
```
Defaults: **640脳640 路 53 frames 路 8 FPS 路 30 sampling steps**.
The script uses the verified shift, guidance, precision and VAE settings.
Change `--prompt` and `--output` for another video; an existing output is never overwritten.
## Examples
Selected outputs from this model. See the [Demo](https://vanzll.github.io/diffusionart-project/demo.html)
for the full gallery and pretrained comparisons.
<table>
<tr>
<td><video controls muted loop playsinline preload="none" width="280" poster="https://vanzll.github.io/diffusionart-project/assets/hf-video-00113-after.jpg" src="https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/resolve/main/examples/00113-diffusionart.mp4"></video><p>A white horse gallops through shallow water along a sunlit beach.</p></td>
<td><video controls muted loop playsinline preload="none" width="280" poster="https://vanzll.github.io/diffusionart-project/assets/hf-video-00139-after.jpg" src="https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/resolve/main/examples/00139-diffusionart.mp4"></video><p>The camera approaches a glass pavilion surrounded by autumn trees.</p></td>
</tr>
<tr>
<td><video controls muted loop playsinline preload="none" width="280" poster="https://vanzll.github.io/diffusionart-project/assets/hf-video-00106-after.jpg" src="https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/resolve/main/examples/00106-diffusionart.mp4"></video><p>The camera follows a winding river through a valley of autumn trees.</p></td>
<td><video controls muted loop playsinline preload="none" width="280" poster="https://vanzll.github.io/diffusionart-project/assets/hf-video-00148-after.jpg" src="https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/resolve/main/examples/00148-diffusionart.mp4"></video><p>Sunlight sparkles through a rotating crystal prism on a white surface.</p></td>
</tr>
</table>
## License
Subject to the [Tencent Hunyuan Community License](https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/blob/main/LICENSE.txt)
and [Notice](https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/blob/main/Notice).
Training provenance and weight hashes are recorded in [release.json](https://huggingface.co/vanzl/DiffusionART-HunyuanVideo/blob/main/release.json).
## Citation
```bibtex
@misc{wan2026diffusionartefficientstablescalable,
title={DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models},
author={Zhenglin Wan and Jiayu Chen and Zhengfeiyang Zhang and Pengfei Zhou and Wangbo Zhao and Fangyuan Kong and Pengfei Wan and Kun Gai and Yang You},
year={2026},
eprint={2610.12572},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2610.12572},
}
```
|