How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("runwayml/stable-diffusion-v1-5", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("yashvoladoddi37/kanji-diffusion-v1-5")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

LoRA text2image fine-tuning - yashvoladoddi37/kanji-diffusion-v1-5

These are LoRA adaption weights for runwayml/stable-diffusion-v1-5. The weights were fine-tuned on the yashvoladoddi37/kanjienglish dataset. You can find some example images in the following.

img_0 img_1 img_2 img_3

How to use

from diffusers import StableDiffusionPipeline
import torch

model_path = "yashvoladoddi37/kanji-diffusion-v1-5"
pipe = StableDiffusionPipeline.from_pretrained("runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16, use_safetensors = True).to("cuda")
pipe.unet.load_attn_procs(model_path)
pipe.to("cuda")

prompt = "a Kanji meaning YouTube"
image = pipe(prompt).images[0]
image.save("youtube-kanji-v1-4.png")
Downloads last month
6
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yashvoladoddi37/kanji-diffusion-v1-5

Adapter
(2742)
this model