| license: apache-2.0 | |
| base_model: lambdalabs/miniSD-diffusers | |
| tags: | |
| - stable-diffusion | |
| - lora | |
| - diffusers | |
| - concept-swap | |
| # Giraffe-Zebra Concept Swap LoRA | |
| This LoRA adapter swaps the concepts of giraffes and zebras in Stable Diffusion. | |
| ## Training Details | |
| - Base Model: lambdalabs/miniSD-diffusers | |
| - LoRA Rank: 64 | |
| - Training Epochs: 30 | |
| - Learning Rate: 0.0002 | |
| ## Usage | |
| ```python | |
| from diffusers import StableDiffusionPipeline | |
| from peft import PeftModel | |
| import torch | |
| # Load base model | |
| pipe = StableDiffusionPipeline.from_pretrained( | |
| "lambdalabs/miniSD-diffusers", | |
| torch_dtype=torch.float16 | |
| ) | |
| # Load LoRA weights | |
| pipe.unet = PeftModel.from_pretrained( | |
| pipe.unet, | |
| "SurenaSa/IOAI2024_CV_Problem_V6_LoRA", | |
| is_trainable=False | |
| ) | |
| pipe.to("cuda") | |
| # Generate | |
| prompt = "a photo of a giraffe" # Will generate a zebra! | |
| image = pipe(prompt, num_inference_steps=30, guidance_scale=7.5).images[0] | |
| image.save("output.png") | |
| ``` | |
| ## Examples | |
| - Prompt: "a photo of a giraffe" → Generates zebra | |
| - Prompt: "a photo of a zebra" → Generates giraffe | |