lambda/pokemon-blip-captions
Viewer • Updated • 833 • 1.79k • 308
How to use sr5434/sd-pokemon-model-lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("sr5434/sd-pokemon-model-lora", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]I trained this model using LoRA and Stable Diffusion v1.4
Sample code:
from diffusers import StableDiffusionPipeline
import torch
model_path = "sr5434/sd-pokemon-model-lora"
pipe = StableDiffusionPipeline.from_pretrained("CompVis/stable-diffusion-v1-4", torch_dtype=torch.float16)
pipe.unet.load_attn_procs(model_path)
pipe.to("cuda")
prompt = input("Prompt:")
image = pipe(prompt, num_inference_steps=50, guidance_scale=7.5).images[0]
image.save("pokemon.png")