Hunyuan video LoRA training study (Single image/style training)
neph1
• • 7How to use neph1/hunyuan_night_graveyard with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("tencent/HunyuanVideo", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("neph1/hunyuan_night_graveyard")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]More info in this article: https://huggingface.co/blog/neph1/hunyuan-lora Trigger word: afkx Example prompt: "A graveyard at night. The scene is shrouded in a thick fog, creating a dark and eerie atmosphere. Numerous tombstones are visible, their inscriptions barely discernible in the dim light. Two large trees stand tall in the foreground, their branches reaching out like skeletal arms. The sky is overcast with a full moon casting a pale glow over the scene. The overall impression is one of mystery and melancholy."
Trained with finetrainers: https://github.com/a-r-r-o-w/finetrainers and https://github.com/neph1/finetrainers-ui
Base model
tencent/HunyuanVideo