Instructions to use byungjun-kim/DWM-Wan2.1-Fun-14b-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use byungjun-kim/DWM-Wan2.1-Fun-14b-LoRA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("fill-in-base-model", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("byungjun-kim/DWM-Wan2.1-Fun-14b-LoRA") prompt = "A man with short gray hair plays a red electric guitar." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
DWM WAN 2.1 14B Hand-Concat LoRA
This folder contains the DWM WAN hand-concat LoRA checkpoint packaged for release from:
outputs/260330/wan2.1_14b_fun_inp_hand_concat_lora_batch_20260330_225432/checkpoint-5000
Files:
lora_diffusion_pytorch_model.safetensorsnon_lora_weights.safetensorsdwm_wan_14b_lora.yaml
This checkpoint is loaded with the DWM WAN inference path in this repository:
python training/wan/inference.py \
--checkpoint_path hf_release/wan2.1_14b_fun_inp_hand_concat_lora_checkpoint-5000 \
--experiment_config /path/to/this_repo/dwm_wan_14b_lora.yaml \
--data_root data \
--video_path /abs/path/to/data/realworld/videos/00001.mp4 \
--prompt_subdir prompts_rewrite \
--output_dir outputs_infer/wan_release_demo
The expected processed sample layout is:
<sample_root>/
βββ videos/
β βββ <stem>.mp4
βββ videos_static/
β βββ <stem>.mp4
βββ videos_hands/
β βββ <stem>.mp4
βββ prompts_rewrite/
βββ <stem>.txt
This release was validated in the DWM repository by loading the packaged folder directly and running single-video inference on realworld/videos/00001.mp4.
- Downloads last month
- 11