lambda/pokemon-blip-captions
Viewer • Updated • 833 • 1.41k • 308
How to use shrikant11/pokemon_text_to_image with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("shrikant11/pokemon_text_to_image", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]This bla bla pipeline was finetuned from runwayml/stable-diffusion-v1-5 on the lambdalabs/pokemon-blip-captions dataset. Below are some example images generated with the finetuned pipeline using the following prompts: ['Pokemon with yellow eyes', 'Green colour pokemon', 'Blue colour pikacchu', 'Charlizzard', 'pikachu', 'dangerous looking pokemon']:
You can use the pipeline like so:
from diffusers import DiffusionPipeline
import torch
pipeline = DiffusionPipeline.from_pretrained("shrikant11/pokemon_text_to_image", torch_dtype=torch.float16)
prompt = "Pokemon with yellow eyes"
image = pipeline(prompt).images[0]
image.save("my_image.png")
These are the key hyperparameters used during training:
More information on all the CLI arguments and the environment are available on your wandb run page.
Base model
runwayml/stable-diffusion-v1-5