Spaces:
Running
on
Zero
Step by ste instruction
- Use jpg format, upload a minimum 1 image to "Input Images".
- Press "Generate LoRA".
- After a moment, your LoRA will be ready to download.
- Press "Generate image" to use LoRA above. The generated image will have similar style as the sample images you uploaded.
If you're using Python, you can use the LoRA above to generate an image using instructions from DiffSynth-Studio (link below).
And if you're happy with the result, please support me by pressing the like button 😄
For ComfyUI
- Download the generated LoRA.
- Use this sample workflow: https://files.catbox.moe/4c6w5f.json
- Replace the lightning LoRA with the LoRA you've been downloaded before.
Credit to u/GBJI from Reddit for the workflow.
Question and Answer
What is a lora?
A LoRA (Low-Rank Adaptation) is a small add-on for a pre-trained image generation model. It's trained on a specific set of images to teach the model a new style, character, or object without retraining the entire model.
Is it different from IP Adapter?
Yes, it is different.
IP Adapters are for style transfer (making your image look like a reference image). LoRA is for fine-tuning (teaching the model new concepts or styles).
What can this app do? This demo helps you make new pictures that look like your example pictures, using a LoRA.
Features
- Use a single image to generate LoRA (though more images are better).
- You can download the LoRA you generate.
- There's also an option to generate an image using the LoRA you created.
Speed
- LoRA generation takes about 20 seconds (H200 ZeroGPU).
- Image generation using LoRA takes about 50 seconds (maybe something wrong here).
References
- DiffSynth-Studio: https://huggingface.co/DiffSynth-Studio/Qwen-Image-i2L