How to use Remade-AI/Cakeify with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-I2V-14B-480P,Wan-AI/Wan2.1-I2V-14B-480P-Diffusers", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("Remade-AI/Cakeify") prompt = "The video opens on a puppy. A knife, held by a hand, is coming into frame and hovering over the puppy. The knife then begins cutting into the puppy to c4k3 cakeify it. As the knife slices the puppy open, the inside of the puppy is revealed to be cake with chocolate layers. The knife cuts through and the contents of the puppy are revealed." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4")
The community tab is the place to discuss and collaborate with the HF community!
