Text-to-Image
Diffusers
stable-diffusion-xl
stable-diffusion-xl-diffusers
diffusers-training
lora
template:sd-lora
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("nicolaus-huang/eng")
prompt = "a word of mychar, white background"
image = pipe(prompt).images[0]SDXL LoRA DreamBooth - nicolaus-huang/eng

- Prompt
- a word of mychar, white background

- Prompt
- a word of mychar, white background

- Prompt
- a word of mychar, white background

- Prompt
- a word of mychar, white background
Model description
These are nicolaus-huang/eng LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
Download model
Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
- LoRA: download
eng.safetensorshere 💾.- Place it on your
models/Lorafolder. - On AUTOMATIC1111, load the LoRA by adding
<lora:eng:1>to your prompt. On ComfyUI just load it as a regular LoRA.
- Place it on your
Use it with the 🧨 diffusers library
from diffusers import AutoPipelineForText2Image
import torch
pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('nicolaus-huang/eng', weight_name='pytorch_lora_weights.safetensors')
image = pipeline('a word of mychar, white background').images[0]
For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers
Trigger words
You should use a word of mychar, white background to trigger the image generation.
Details
All Files & versions.
The weights were trained using 🧨 diffusers Advanced Dreambooth Training Script.
LoRA for the text encoder was enabled. True.
Pivotal tuning was enabled: False.
Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
- Downloads last month
- 9
Model tree for nicolaus-huang/eng
Base model
stabilityai/stable-diffusion-xl-base-1.0