How to use Remade-AI/Pirate-Captain with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-I2V-14B-480P,Wan-AI/Wan2.1-I2V-14B-480P-Diffusers", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("Remade-AI/Pirate-Captain") prompt = "The video begins with a cat. The image then transitions to the p1r4t3 pirate captain transformation. The cat is wearing a black pirate hat with a red band around it, a coat and pants, and a pirate style sash. The scene changes, showing the cat on a wooden ship. The cat has long dreadlock style hair and a sword. The scene changes again to show the cat with his sword, in the same location on the boat." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4")
The community tab is the place to discuss and collaborate with the HF community!
