cartoon-lora-balanced-constant

Fine-tuned LoRA model for generating colorful cartoon-style illustrations.

Model Details

• Base Model: runwayml/stable-diffusion-v1-5
• Dataset: juliaturc/captioned-cartoons
• Training Framework: Diffusers + LoRA
• Task: Text-to-Image Generation (Cartoon Style)

Training Configuration

{
  "learning_rate": 0.0001,
  "max_train_steps": 1000,
  "rank": 24,
  "lr_scheduler": "constant"
}

Usage

Install dependencies

pip install diffusers transformers torch

Load and generate

import torch
from diffusers import StableDiffusionPipeline

# Load base model
model_id = "runwayml/stable-diffusion-v1-5"
pipe = StableDiffusionPipeline.from_pretrained(
    model_id,
    torch_dtype=torch.float16
)
pipe = pipe.to("cuda")

# Load LoRA weights
pipe.load_lora_weights("yzhdvbQ/cartoon-lora-balanced-constant")

# Generate image
prompt = "Two people walking in a park with dogs, colorful cartoon style, woman in pink shirt, man in green vest, fall scenery"
image = pipe(prompt, num_inference_steps=30).images[0]
image.save("output.png")

Example Prompts

1. Two people walking in a park with dogs, colorful cartoon style, woman in pink shirt, man in green vest, fall scenery
2. A young woman sitting on a bench reading a book in a city park, wearing a yellow sweater and jeans, autumn trees, colorful cartoon illustration
3. A happy family having a picnic in a meadow, parents and two children, red checkered blanket, colorful cartoon style

Training Details

This model was fine-tuned on a cartoon illustration dataset with detailed captions describing:

• Characters and their appearance
• Clothing and accessories
• Actions and poses
• Environment and scenery
• Composition and style

The training used Low-Rank Adaptation (LoRA) to efficiently fine-tune Stable Diffusion while keeping the base model frozen.

Limitations

• Works best with detailed, descriptive prompts
• Optimized for cartoon/illustration style
• May not perform well on photorealistic requests
• Based on Stable Diffusion 1.5 architecture

Citation

@misc{cartoon-lora-ai54,
  author = {AI54 Course},
  title = {Cartoon LoRA for Stable Diffusion},
  year = {2026},
  publisher = {HuggingFace},
  url = {https://huggingface.co/yzhdvbQ/cartoon-lora-balanced-constant}
}

License

This model inherits the license from Stable Diffusion (OpenRAIL++)