Instructions to use Remade-AI/VIP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Remade-AI/VIP with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-I2V-14B-480P,Wan-AI/Wan2.1-I2V-14B-480P-Diffusers", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("Remade-AI/VIP") prompt = "The video begins with an image of purple Thanos from Marvel. Then the v1p red carpet transformation appears. Purple Thanos is shown wearing a black dress, with gold jewelry around his neck and ears. The image is again of purple Thanos looking straight at the camera against a more lighted gray background. The v1p red carpet transformation continues, purple Thanos is now on the red carpet with photographers taking pictures and other people behind a barricade to the sides. Purple Thanos is wearing the same black dress and jewelry, in focus at the center of the frame. " input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Upload 2 files
Browse files- .gitattributes +2 -0
- example_videos/man_vip.mp4 +3 -0
- example_videos/thanos_vip.mp4 +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
example_videos/man_vip.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
example_videos/thanos_vip.mp4 filter=lfs diff=lfs merge=lfs -text
|
example_videos/man_vip.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2c373964ef6ce926501b151c83c04e7bbef875297e1111f75ef2d52bcc44d3bd
|
| 3 |
+
size 643806
|
example_videos/thanos_vip.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8da70324574674b74a02ff0dad1d0f1d01666ef63b889bb8a28b3ef81c4a83b
|
| 3 |
+
size 1183639
|