Instructions to use AlekseyCalvin/Wan1.3B_CausVid_LoRA_MisubiDiffusers_Conversion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AlekseyCalvin/Wan1.3B_CausVid_LoRA_MisubiDiffusers_Conversion with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-T2V-1.3B", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("AlekseyCalvin/Wan1.3B_CausVid_LoRA_MisubiDiffusers_Conversion") prompt = "A man with short gray hair plays a red electric guitar." output = pipe(prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: Wan-AI/Wan2.1-T2V-1.3B
|
| 4 |
+
tags:
|
| 5 |
+
- wan
|
| 6 |
+
- video
|
| 7 |
+
- text-to-video
|
| 8 |
+
- diffusion-pipe
|
| 9 |
+
- lora
|
| 10 |
+
- template:sd-lora
|
| 11 |
+
- standard
|
| 12 |
+
library_name: diffusers
|
| 13 |
+
pipeline_tag: text-to-video
|
| 14 |
+
---
|
| 15 |
+
## CausVid Accelerator Misubi-format Conversion
|
| 16 |
+
## Text/Image to Video Low Rank Adapter (LoRA)
|
| 17 |
+
## For Wan2.1 1.3B family models (Base, Skyreels V2, FunINP1.3B, etc...)
|
| 18 |
+
|
| 19 |
+
Based on [Kijal's original ComfyUI-oriented LoRA extraction](https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan21_CausVid_bidirect2_T2V_1_3B_lora_rank32.safetensors) of the CausVid accelerated mod of Wan2.1 1.3B. <br>
|
| 20 |
+
This conversion **might** work better than Kijal's source for those using CausVid outside of a ComfyUI environment. <br>
|
| 21 |
+
**Try this version if:** Kijal's original LoRA does not work **at all** for you and crashes/fails to infer. <br>
|
| 22 |
+
*For example:* This version **works in DrawThings**, whereas Kijal's original does not (as of the time I write this) & simply crashes. <br>
|
| 23 |
+
This might (or might not) extend to other given non-Comfy Wan-inference environments/backends/frameworks. <br>
|
| 24 |
+
Please share any other confirmed use cases in the "Community" tab! <br>
|