Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,37 @@ license: apache-2.0
|
|
| 26 |
- [1 Node/GPU debugging finetuning script](https://github.com/hao-ai-lab/FastVideo/blob/main/scripts/finetune/finetune_v1_VSA.sh)
|
| 27 |
- [Slurm training example script](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/training/finetune/Wan2.1-VSA/Wan-Syn-Data/T2V-14B-VSA.slurm)
|
| 28 |
- [Inference script](https://github.com/hao-ai-lab/FastVideo/blob/main/scripts/inference/v1_inference_wan_VSA.sh)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
- Try it out on **FastVideo** — we support a wide range of GPUs from **H100** to **4090**
|
| 30 |
- We use [FastVideo 720P Synthetic Wan dataset](https://huggingface.co/datasets/FastVideo/Wan-Syn_77x768x1280_250k) for training.
|
| 31 |
|
|
|
|
| 26 |
- [1 Node/GPU debugging finetuning script](https://github.com/hao-ai-lab/FastVideo/blob/main/scripts/finetune/finetune_v1_VSA.sh)
|
| 27 |
- [Slurm training example script](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/training/finetune/Wan2.1-VSA/Wan-Syn-Data/T2V-14B-VSA.slurm)
|
| 28 |
- [Inference script](https://github.com/hao-ai-lab/FastVideo/blob/main/scripts/inference/v1_inference_wan_VSA.sh)
|
| 29 |
+
```python
|
| 30 |
+
|
| 31 |
+
git clone https://github.com/hao-ai-lab/FastVideo
|
| 32 |
+
pip install -e .
|
| 33 |
+
cd csrc/attn
|
| 34 |
+
git submodule update --init --recursive
|
| 35 |
+
python setup_vsa.py install
|
| 36 |
+
|
| 37 |
+
num_gpus=1
|
| 38 |
+
export FASTVIDEO_ATTENTION_BACKEND=VIDEO_SPARSE_ATTN
|
| 39 |
+
# change model path to local dir if you want to inference using your checkpoint
|
| 40 |
+
export MODEL_BASE=Wan-AI/Wan2.1-T2V-1.3B-Diffusers
|
| 41 |
+
# export MODEL_BASE=hunyuanvideo-community/HunyuanVideo
|
| 42 |
+
fastvideo generate \
|
| 43 |
+
--model-path $MODEL_BASE \
|
| 44 |
+
--sp-size $num_gpus \
|
| 45 |
+
--tp-size 1 \
|
| 46 |
+
--num-gpus $num_gpus \
|
| 47 |
+
--height 448 \
|
| 48 |
+
--width 832 \
|
| 49 |
+
--num-frames 77 \
|
| 50 |
+
--num-inference-steps 50 \
|
| 51 |
+
--fps 16 \
|
| 52 |
+
--guidance-scale 6.0 \
|
| 53 |
+
--flow-shift 8.0 \
|
| 54 |
+
--VSA-sparsity 0.9 \
|
| 55 |
+
--prompt "A beautiful woman in a red dress walking down a street" \
|
| 56 |
+
--negative-prompt "Bright tones, overexposed, static, blurred details, subtitles, style, works, paintings, images, static, overall gray, worst quality, low quality, JPEG compression residue, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn faces, deformed, disfigured, misshapen limbs, fused fingers, still picture, messy background, three legs, many people in the background, walking backwards" \
|
| 57 |
+
--seed 1024 \
|
| 58 |
+
--output-path outputs_video_1.3B_VSA/sparsity_0.9/
|
| 59 |
+
```
|
| 60 |
- Try it out on **FastVideo** — we support a wide range of GPUs from **H100** to **4090**
|
| 61 |
- We use [FastVideo 720P Synthetic Wan dataset](https://huggingface.co/datasets/FastVideo/Wan-Syn_77x768x1280_250k) for training.
|
| 62 |
|