Text-to-Image
Diffusers
Safetensors
StableDiffusionPipeline
stable-diffusion
stable-diffusion-diffusers
How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("lyogavin/pint_char_img_bat1-4_v15", dtype=torch.bfloat16, device_map="cuda")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

Text-to-image finetuning - lyogavin/pint_char_img_bat1-4_v15

This pipeline was finetuned from runwayml/stable-diffusion-v1-5 on the lyogavin/pint_char_anim_interr_static_img_bat1-4 dataset. Below are some example images generated with the finetuned pipeline using the following prompts: ['a pixel art of a fire breathing man with a sword, melted cyborg, featured on dribbble, symmetry!! yellow ranger, biker, fantasy ttrpg villain, engulfed in flames, laser wip, in style of primal apes, blackened space, 8bits videogame', 'a pixel art of a fire breathing man with a sword, melted cyborg, featured on dribbble, symmetry!! yellow ranger, biker, fantasy ttrpg villain, engulfed in flames, laser wip, in style of primal apes, blackened space, 8bits videogame', 'a pixel art of a fire breathing man with a sword, melted cyborg, featured on dribbble, symmetry!! yellow ranger, biker, fantasy ttrpg villain, engulfed in flames, laser wip, in style of primal apes, blackened space, 8bits videogame', 'a close up of a cartoon dragon with a purple and blue head, game concept art sprite sheet, rhino beetle, by Shitao, made of lava, laser wip, bulbasaur, metal border, very clear image, tank, 64x64, from overlord, inside stylized border', 'a close up of a cartoon dragon with a purple and blue head, game concept art sprite sheet, rhino beetle, by Shitao, made of lava, laser wip, bulbasaur, metal border, very clear image, tank, 64x64, from overlord, inside stylized border', 'a close up of a cartoon dragon with a purple and blue head, game concept art sprite sheet, rhino beetle, by Shitao, made of lava, laser wip, bulbasaur, metal border, very clear image, tank, 64x64, from overlord, inside stylized border']:

val_imgs_grid

Pipeline usage

You can use the pipeline like so:

from diffusers import DiffusionPipeline
import torch

pipeline = DiffusionPipeline.from_pretrained("lyogavin/pint_char_img_bat1-4_v15", torch_dtype=torch.float16)
prompt = "a pixel art of a fire breathing man with a sword, melted cyborg, featured on dribbble, symmetry!! yellow ranger, biker, fantasy ttrpg villain, engulfed in flames, laser wip, in style of primal apes, blackened space, 8bits videogame"
image = pipeline(prompt).images[0]
image.save("my_image.png")

Training info

These are the key hyperparameters used during training:

  • Epochs: 97
  • Learning rate: 1e-05
  • Batch size: 4
  • Gradient accumulation steps: 1
  • Image resolution: 512
  • Mixed-precision: fp16

More information on all the CLI arguments and the environment are available on your wandb run page.

Downloads last month
2
Safetensors
Model size
0.9B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lyogavin/pint_char_img_bat1-4_v15

Finetuned
(604)
this model