Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,98 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc0-1.0
|
| 3 |
+
base_model:
|
| 4 |
+
- Wan-AI/Wan2.2-T2V-A14B
|
| 5 |
+
pipeline_tag: text-to-video
|
| 6 |
+
tags:
|
| 7 |
+
- lora
|
| 8 |
+
- wan
|
| 9 |
+
- text-to-video
|
| 10 |
+
- object-typography
|
| 11 |
+
- creative
|
| 12 |
+
- artistic
|
| 13 |
+
- text-to-image
|
| 14 |
+
- diffusers
|
| 15 |
+
- template:diffusion-lora
|
| 16 |
+
widget:
|
| 17 |
+
- text: >-
|
| 18 |
+
ObjectTypography. Aerial drone shot slowly revealing the word "GROW" formed by different stages of crop growth in agricultural fields. The 'G' is freshly plowed dark soil, 'R' is young green sprouts, 'O' is mature golden wheat, and 'W' is being harvested. The patchwork of fields creates a living timeline. Warm afternoon light, pastoral landscape.
|
| 19 |
+
output:
|
| 20 |
+
url: Videos/07229fd7-4606-4413-b9d4-14c3d651dba8.mp4
|
| 21 |
+
- text: >-
|
| 22 |
+
ObjectTypography. Wide shot of an abandoned industrial warehouse where shafts of dusty sunlight streaming through broken roof panels spell "DECAY". Light beams cut through the darkness, particles floating in the illuminated air. Crumbling concrete and rusted machinery scattered throughout. Cinematic lighting, post-apocalyptic atmosphere, nature reclaiming man-made structures.
|
| 23 |
+
output:
|
| 24 |
+
url: Videos/10afd850-5c9d-4546-a4f8-bd1b019ab69a.mp4
|
| 25 |
+
- text: >-
|
| 26 |
+
ObjectTypography. Bird's eye view of a skate park at dusk where skateboarders' chalk trails and scuff marks on black concrete spell "GRIND". The worn patterns from years of skating create weathered, organic letterforms. A few skaters are mid-trick, adding motion blur. Sodium vapor lights beginning to illuminate the scene. Urban, raw, authentic street culture aesthetic.
|
| 27 |
+
output:
|
| 28 |
+
url: Videos/3cfbe843-5a71-4220-9c03-ecb37621d1d6.mp4
|
| 29 |
+
- text: >-
|
| 30 |
+
ObjectTypography. Neon signs in various colors flickering and buzzing to spell "GLOW" on a rain-soaked brick wall at night. Each letter is a different style of vintage neon - pink, cyan, yellow, and purple. Puddles on the ground reflect the luminous text. Steam rises from a nearby manhole. Shot in cyberpunk style with heavy grain and chromatic aberration.
|
| 31 |
+
output:
|
| 32 |
+
url: Videos/413c691a-7f5f-43fb-9a12-09267820b672.mp4
|
| 33 |
+
- text: >-
|
| 34 |
+
ObjectTypography. High-angle shot of a massive junkyard where crushed and stacked vintage cars are arranged to spell "RUST" in towering letters. Each letter is 30 feet tall, constructed from oxidized metal in shades of orange, brown, and red. Overcast sky, industrial atmosphere, with a small figure welding at the base for scale. Cinematic composition.
|
| 35 |
+
output:
|
| 36 |
+
url: Videos/4494bbab-22e4-4950-b91e-878a1fb3a7c5.mp4
|
| 37 |
+
- text: >-
|
| 38 |
+
ObjectTypography. Wide-angle shot of lightning strikes during a thunderstorm simultaneously forming the word "STRIKE" across a dark purple sky. Multiple bolts branch and fork to create the letters in a single moment. Silhouetted landscape below, rain visible as streaks. Dramatic storm clouds, electric energy, captured in that split-second of natural power. High-speed photography, raw elemental force.
|
| 39 |
+
output:
|
| 40 |
+
url: Videos/6fb6077e-854f-4091-98a9-bdf008d07c72.mp4
|
| 41 |
+
---
|
| 42 |
+
|
| 43 |
+
# **ObjectTypography LoRA for Wan**
|
| 44 |
+
|
| 45 |
+
<Gallery />
|
| 46 |
+
|
| 47 |
+
---
|
| 48 |
+
|
| 49 |
+
> **Special Thanks:**
|
| 50 |
+
> This project was made possible thanks to generous sponsorship and GPU time provided by [reDMOND Ai](https://redmond.ai ).
|
| 51 |
+
> We are grateful for their support in training this LoRA.
|
| 52 |
+
|
| 53 |
+
---
|
| 54 |
+
|
| 55 |
+
## Model Description
|
| 56 |
+
|
| 57 |
+
This LoRA specializes in creating ObjectTypography - a creative technique where words and letters are formed by natural and man-made objects in the environment. The model excels at spelling out words through clever arrangements of elements like crops, light, shadows, natural formations, and urban textures.
|
| 58 |
+
|
| 59 |
+
This version is specifically adapted for use with **Wan-AI** models, like `Wan2.2-T2V-A14B`.
|
| 60 |
+
|
| 61 |
+
## Trigger Words
|
| 62 |
+
|
| 63 |
+
The trigger phrase is `ObjectTypography`.
|
| 64 |
+
|
| 65 |
+
For best results, start your prompt with "ObjectTypography." followed by a description of how a word is formed by objects in a scene. The model will create dynamic, artistic compositions where letters emerge from environmental elements.
|
| 66 |
+
|
| 67 |
+
## Setup for ComfyUI
|
| 68 |
+
|
| 69 |
+
To use this LoRA in ComfyUI, simply place the file in your `loras` directory:
|
| 70 |
+
|
| 71 |
+
- Download `ObjectTypography-WAN22.safetensors` and place it in `ComfyUI/models/loras/`
|
| 72 |
+
|
| 73 |
+
Ensure your ComfyUI environment is already configured to run Wan models.
|
| 74 |
+
|
| 75 |
+
## Example Workflow (ComfyUI)
|
| 76 |
+
|
| 77 |
+
In your ComfyUI workflow, add a **Load LoRA** node after your base model loader.
|
| 78 |
+
|
| 79 |
+
1. Load your base **Wan** model.
|
| 80 |
+
2. Connect the output of the model loader to the `model` input of the **Load LoRA** node.
|
| 81 |
+
3. Select `ObjectTypography-WAN22.safetensors` in the Load LoRA node.
|
| 82 |
+
4. Connect the `MODEL` output of the LoRA node to your KSampler.
|
| 83 |
+
5. Adjust the `strength_model` as needed (0.8-1.0 is a good starting point).
|
| 84 |
+
|
| 85 |
+
### **References**
|
| 86 |
+
- **Base Model:** [Wan-AI/Wan2.2-T2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B)
|
| 87 |
+
- **ComfyUI:** [comfyanonymous/ComfyUI](https://github.com/comfyanonymous/ComfyUI )
|
| 88 |
+
|
| 89 |
+
---
|
| 90 |
+
### 🌐 Website
|
| 91 |
+
You can find more of my models, projects, and information on my official website:
|
| 92 |
+
- **[artificialguy.com](https://artificialguy.com/ )**
|
| 93 |
+
|
| 94 |
+
### 💖 Support My Work
|
| 95 |
+
If you find this model useful, please consider supporting my work. It helps me cover server costs and dedicate more time to new open-source projects.
|
| 96 |
+
- **Patreon:** [Support on Patreon](https://www.patreon.com/user?u=81570187 )
|
| 97 |
+
- **Ko-fi:** [Buy me a Ko-fi](https://ko-fi.com/artificialguybr )
|
| 98 |
+
- **Buy Me a Coffee:** [Buy me a Coffee](https://buymeacoffee.com/jvkape )
|