README.md

---
tags:
- stable-diffusion-xl
- stable-diffusion-xl-diffusers
- text-to-image
- diffusers
- lora
- template:sd-lora

base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: Warhol style
license: openrail++
---
    
# SDXL LoRA - tonyassi/warhol-lora

by [Tony Assi](https://www.tonyassi.com/)

Lora style based on Andy Warhol prints.

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/cIGv_JDHJN0eSV85slnEL.jpeg)

## Trigger words
Use **Warhol style** in the prompt to trigger the style.

## How to use
```bash
pip install diffusers accelerate
```

```python
import torch
from diffusers import DiffusionPipeline, AutoencoderKL

# Load the pipeline
vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16)
pipe = DiffusionPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
    vae=vae,
    torch_dtype=torch.float16,
    variant="fp16",
    use_safetensors=True
)
pipe.load_lora_weights("tonyassi/warhol-lora")
pipe.to("cuda")

# Generate image
prompt = "Warhol style, Bella Hadid"
image = pipe(prompt=prompt,
             height=1024, 
             width=1024,
             num_inference_steps=50,
             negative_prompt="ugly, deformed face, deformed body").images[0]
image

```

## Examples


![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/ig4vwNzuFUzxpxzCp9AzE.jpeg)
**Warhol style, Bella Hadid**

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/rb9VyKVqKGD69jRNlXpFA.jpeg)
**Warhol style, Lady Gaga**

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/_oKmDSKLs7hurWWgXja-i.jpeg)
**Warhol style, Nicole Kidman**

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/5ZusrHXQWr25PEB28Y8ut.jpeg)
**Warhol style, A$AP Rocky**

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/PfAppXxw3J226dDip4egh.jpeg)
**Warhol style, Scarlett Johansson**

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/648a824a8ca6cf9857d1349c/TKR_mLgYp1IW12bNlSjna.jpeg)
**Warhol style, David Bowie**

## Model description
These are tonyassi/warhol-lora LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.

The weights were trained using [DreamBooth](https://dreambooth.github.io/).

LoRA for the text encoder was enabled: False.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.

## Download model
Weights for this model are available in Safetensors format.

[Download](https://huggingface.co/tonyassi/warhol-lora/tree/main) them in the Files & versions tab.