Qwen-Image-Exp-LoRA
Collection
Illustration Design, Style Intermix โข 6 items โข Updated โข 4
How to use prithivMLmods/Qwen-Image-Sketch-Smudge with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("Qwen/Qwen-Image", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("prithivMLmods/Qwen-Image-Sketch-Smudge")
prompt = "Sketch Smudge, A medium-sized sketch of a womans face is depicted on a stark white background. The womans head is facing the left side of the frame, her hair cascading over her shoulders. Her eyes are squinted and her lips are pursed. She is wearing a short-sleeved brown shirt with a collar around her neck. Her hair is a dark brown color, and her bangs are a darker shade of brown. Her eyebrows are a lighter shade of black, and she has a slight smile on her face. There are three blue circles surrounding her head, adding a pop of color to the scene."
image = pipe(prompt).images[0]


Image Processing Parameters
| Parameter | Value | Parameter | Value |
|---|---|---|---|
| LR Scheduler | constant | Noise Offset | 0.03 |
| Optimizer | AdamW | Multires Noise Discount | 0.1 |
| Network Dim | 64 | Multires Noise Iterations | 10 |
| Network Alpha | 32 | Repeat & Steps | 22 & 2850 |
| Epoch | 20 | Save Every N Epochs | 1 |
Labeling: florence2-en(natural language & English)
Total Images Used for Training : 30 [HQ Images]
| Source | Link |
|---|---|
| Playground | playground.com |
| ArtStation | artstation.com |
| 4K Wallpapers | 4kwallpapers.com |
| Dimensions | Aspect Ratio | Recommendation |
|---|---|---|
| 1472 x 1140 | 4:3 (approx.) | Best |
| 1024 x 1024 | 1:1 | Default |
import torch
from diffusers import DiffusionPipeline
base_model = "Qwen/Qwen-Image"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "prithivMLmods/Qwen-Image-Sketch-Smudge"
trigger_word = "Sketch Smudge"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
You should use Sketch Smudge to trigger the image generation.
Download them in the Files & versions tab.
Base model
Qwen/Qwen-Image