Remade commited on
Commit
ea9c7bf
·
verified ·
1 Parent(s): 397ab18

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +123 -0
README.md ADDED
@@ -0,0 +1,123 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Wan-AI/Wan2.1-I2V-14B-480P
7
+ - Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
8
+ pipeline_tag: image-to-video
9
+ tags:
10
+ - text-to-image
11
+ - lora
12
+ - diffusers
13
+ - template:diffusion-lora
14
+ - image-to-video
15
+ widget:
16
+ - text: >-
17
+ The video shows an elderly man with a long white beard, glasses, and a work shirt working on radios on a wooden table in a workshop filled with vintage radios. The man is concentrating on fixing a radio. The cr4n3 crane down camera motion begins high, looking over the man's shoulder, slowly lowering the view to show him repairing the radio more closely, focusing on his hands. The camera continues to move downwards, getting closer to the radios on the table.
18
+ output:
19
+ url: example_videos/1.mp4
20
+ - text: >-
21
+ The video focuses on a woman in a bathtub, seen from the chest up, with water reaching her nose. Her eyes are wide open, staring directly ahead. A cr4n3 crane down camera motion slowly lowers the perspective, and her hands reach out, slightly visible, toward the camera. The water gently ripples, creating a reflection.
22
+ output:
23
+ url: example_videos/2.mp4
24
+
25
+ ---
26
+
27
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
28
+ <h1 style="color: #24292e; margin-top: 0;">Crane down LoRA for Wan2.1 14B I2V 480p</h1>
29
+
30
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
31
+ <h2 style="color: #24292e; margin-top: 0;">Overview</h2>
32
+ <p>Moves the camera smoothly from a high angle downward, revealing subjects or settings with a cinematic descent. Ideal for dramatic entrances, scene introductions, or shifting focus from environment to character.This LoRA is trained on the Wan2.1 14B I2V 480p model.
33
+ </p>
34
+ </div>
35
+
36
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
37
+ <h2 style="color: #24292e; margin-top: 0;">Features</h2>
38
+ <ul style="margin-bottom: 0;">
39
+ <li>Trained on the Wan2.1 14B 480p I2V base model</li>
40
+ <li>Consistent results across different object types</li>
41
+ <li>Simple prompt structure that's easy to adapt</li>
42
+ </ul>
43
+ </div>
44
+
45
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
46
+ <h2 style="color: #24292e; margin-top: 0;">Community</h2>
47
+ <ul style="margin-bottom: 0;">
48
+ <li>
49
+ Generate videos with 100+ Camera Control and VFX LoRAs on the
50
+ <a href="https://app.remade.ai/canvas/create" style="color: #0366d6; text-decoration: none;">Remade Canvas</a>.
51
+ </li>
52
+ <li>
53
+ <b>Discord:</b>
54
+ <a href="https://remade.ai/join-discord?utm_source=Huggingface&utm_medium=Social&utm_campaign=model_release&utm_content=crane_down" style="color: #0366d6; text-decoration: none;">
55
+ Join our community
56
+ </a> to generate videos with this LoRA for free
57
+ </li>
58
+ </ul>
59
+ </div>
60
+
61
+ <Gallery />
62
+
63
+ # Model File and Inference Workflow
64
+
65
+ ## 📥 Download Links:
66
+
67
+ - [crane_down.safetensors](./crane_down.safetensors) - LoRA Model File
68
+ - [wan_img2vid_lora_workflow.json](./workflow_I2V/wan_img2vid_lora_workflow.json) - Wan I2V with LoRA Workflow for ComfyUI
69
+
70
+ ---
71
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
72
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
73
+ <h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
74
+ <ul style="margin-bottom: 0;">
75
+ <li><b>LoRA Strength:</b> 1.0</li>
76
+ <li><b>Embedded Guidance Scale:</b> 6.0</li>
77
+ <li><b>Flow Shift:</b> 5.0</li>
78
+ </ul>
79
+ </div>
80
+
81
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
82
+ <h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
83
+ <p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">cr4n3 crane down camera motion</code></p>
84
+ </div>
85
+
86
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
87
+ <h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
88
+ <p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
89
+
90
+
91
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
92
+ <h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
93
+ <p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
94
+ <img src="./workflow_I2V/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
95
+ <p>See the Downloads section above for the modified workflow.</p>
96
+ </div>
97
+ </div>
98
+
99
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
100
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
101
+ <h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
102
+ <p>The model weights are available in Safetensors format. See the Downloads section above.</p>
103
+ </div>
104
+
105
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
106
+ <h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
107
+ <ul style="margin-bottom: 0;">
108
+ <li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
109
+ <li><b>Training Data:</b> Trained on 50 seconds of video comprised of 10 short clips (each clip captioned separately) of scenes that used the crane down camera motion.</li>
110
+ <li><b> Epochs:</b> 40</li>
111
+ </ul>
112
+ </div>
113
+
114
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
115
+ <h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
116
+ <p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
117
+ </div>
118
+
119
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
120
+ <h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
121
+ <p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
122
+ </div>
123
+ </div>