gustaveklimt2 / README.md

davidrd123

Upload folder using huggingface_hub

e7aa874 verified over 1 year ago

preview code

raw

history blame contribute delete

7.79 kB

metadata

tags:
  - stable-diffusion-xl
  - stable-diffusion-xl-diffusers
  - text-to-image
  - diffusers
  - lora
  - template:sd-lora
widget:
  - text: <s0><s1> a painting of a woman in a hat and dress
    output:
      url: image-0.png
  - text: <s0><s1> a painting of a nude woman on a leopard print
    output:
      url: image-1.png
  - text: <s0><s1> a painting of a woman in a dress
    output:
      url: image-2.png
  - text: <s0><s1> a painting of a woman with a large hat
    output:
      url: image-3.png
  - text: <s0><s1> the kiss, klimt
    output:
      url: image-4.png
  - text: <s0><s1> a painting of a woman with her back to the viewer
    output:
      url: image-5.png
  - text: <s0><s1> the bed of nina by gustav klimt
    output:
      url: image-6.png
  - text: <s0><s1> the death of klimt, klimt, klimt, klimt
    output:
      url: image-7.png
  - text: <s0><s1> a painting of a woman in a colorful dress
    output:
      url: image-8.png
  - text: <s0><s1> a painting of a woman with a snake in her hand
    output:
      url: image-9.png
  - text: <s0><s1> a painting of a woman with a dog
    output:
      url: image-10.png
  - text: <s0><s1> a painting of a woman with a snake in her hand
    output:
      url: image-11.png
  - text: <s0><s1> a painting of a woman with a gold headdress
    output:
      url: image-12.png
  - text: <s0><s1> a painting of a woman with a gold headdress
    output:
      url: image-13.png
  - text: <s0><s1> a painting of a woman with a fan and flowers
    output:
      url: image-14.png
  - text: <s0><s1> a painting of a woman with a hat and scarf
    output:
      url: image-15.png
  - text: <s0><s1> a painting of a young girl in a white dress
    output:
      url: image-16.png
  - text: <s0><s1> a painting of a woman in gold with a spear
    output:
      url: image-17.png
  - text: <s0><s1> a painting of a woman in gold with a spear
    output:
      url: image-18.png
  - text: <s0><s1> a painting of a woman with a scarf on her head
    output:
      url: image-19.png
  - text: <s0><s1> the gold and white painting of a woman in a gold dress
    output:
      url: image-20.png
  - text: <s0><s1> a painting of a woman in a traditional dress
    output:
      url: image-21.png
  - text: <s0><s1> a painting of a woman in white standing on a rug
    output:
      url: image-22.png
  - text: <s0><s1> a painting of a woman in a blue dress
    output:
      url: image-23.png
  - text: <s0><s1> a painting of a woman in a colorful kimono
    output:
      url: image-24.png
  - text: <s0><s1> a woman in a white dress
    output:
      url: image-25.png
  - text: <s0><s1> a painting of a woman in a white dress
    output:
      url: image-26.png
  - text: <s0><s1> a painting of a woman wearing a blue and black dress
    output:
      url: image-27.png
  - text: <s0><s1> a painting of a woman in a white dress
    output:
      url: image-28.png
  - text: <s0><s1> a painting of a woman with flowers on her head
    output:
      url: image-29.png
  - text: <s0><s1> a painting of a woman in a black dress
    output:
      url: image-30.png
  - text: <s0><s1> the painting shows a group of women and a man
    output:
      url: image-31.png
  - text: <s0><s1> the three women by gustav klimt
    output:
      url: image-32.png
  - text: <s0><s1> a painting with gold and white on it
    output:
      url: image-33.png
  - text: <s0><s1> a painting of a woman and two men
    output:
      url: image-34.png
  - text: <s0><s1> the four nymphs by gustav klimt
    output:
      url: image-35.png
  - text: <s0><s1> a painting of a woman with flowers in front of a table
    output:
      url: image-36.png
  - text: <s0><s1> the kiss by gustav klimt
    output:
      url: image-37.png
  - text: <s0><s1> a painting of a woman and a man
    output:
      url: image-38.png
  - text: <s0><s1> the woman with the golden hair by gustav klimt
    output:
      url: image-39.png
  - text: <s0><s1> the two women by gustav klimt
    output:
      url: image-40.png
  - text: <s0><s1> the birth of the muse by gustav klimt
    output:
      url: image-41.png
  - text: <s0><s1> a painting of a woman in gold and black
    output:
      url: image-42.png
  - text: <s0><s1> a painting of a woman laying on a bed with flowers
    output:
      url: image-43.png
  - text: <s0><s1> the kiss by gustav klimt
    output:
      url: image-44.png
  - text: <s0><s1> gustav klimt - woman with flowers
    output:
      url: image-45.png
  - text: <s0><s1> gustav klimt - the woman with the golden dress
    output:
      url: image-46.png
  - text: <s0><s1> the woman with the snake by gustav klimt
    output:
      url: image-47.png
  - text: <s0><s1> gustav klimt - the mother and child
    output:
      url: image-48.png
  - text: <s0><s1> a painting of a woman with flowers in front of a table
    output:
      url: image-49.png
  - text: <s0><s1> the kiss by gustav klimt
    output:
      url: image-50.png
  - text: <s0><s1> gustav klimt - the nymphs
    output:
      url: image-51.png
  - text: <s0><s1> a painting of a woman with a fan and flowers
    output:
      url: image-52.png
base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: <s0><s1>
license: openrail++

SDXL LoRA DreamBooth - davidrd123/gustaveklimt2

Prompt

<s0><s1> a painting of a woman in a hat and dress

Prompt

<s0><s1> a painting of a nude woman on a leopard print

Prompt

<s0><s1> a painting of a woman in a dress

Prompt

<s0><s1> a painting of a woman with a large hat

Prompt

<s0><s1> a painting of a woman with her back to the viewer

Prompt

<s0><s1> the bed of nina by gustav klimt

Prompt

<s0><s1> the death of klimt, klimt, klimt, klimt

Prompt

<s0><s1> a painting of a woman in a colorful dress

Prompt

<s0><s1> a painting of a woman with a snake in her hand

Prompt

<s0><s1> a painting of a woman with a dog

Prompt

<s0><s1> a painting of a woman with a gold headdress

Prompt

<s0><s1> a painting of a woman with a fan and flowers

Prompt

<s0><s1> a painting of a woman with a hat and scarf

Prompt

<s0><s1> a painting of a young girl in a white dress

Prompt

<s0><s1> a painting of a woman in gold with a spear

Prompt

<s0><s1> a painting of a woman with a scarf on her head

Prompt

<s0><s1> the gold and white painting of a woman in a gold dress

Prompt

<s0><s1> a painting of a woman in a traditional dress

Prompt

<s0><s1> a painting of a woman in white standing on a rug

Prompt

<s0><s1> a painting of a woman in a blue dress

Prompt

<s0><s1> a painting of a woman in a colorful kimono

Prompt

<s0><s1> a woman in a white dress

Prompt

<s0><s1> a painting of a woman in a white dress

Prompt

<s0><s1> a painting of a woman wearing a blue and black dress

Prompt

<s0><s1> a painting of a woman with flowers on her head

Prompt

<s0><s1> a painting of a woman in a black dress

Prompt

<s0><s1> the painting shows a group of women and a man

Prompt

<s0><s1> the three women by gustav klimt

Prompt

<s0><s1> a painting with gold and white on it

Prompt

<s0><s1> a painting of a woman and two men

Prompt

<s0><s1> the four nymphs by gustav klimt

Prompt

<s0><s1> a painting of a woman with flowers in front of a table

Prompt

<s0><s1> the kiss by gustav klimt

Prompt

<s0><s1> a painting of a woman and a man

Prompt

<s0><s1> the woman with the golden hair by gustav klimt

Prompt

<s0><s1> the two women by gustav klimt

Prompt

<s0><s1> the birth of the muse by gustav klimt

Prompt

<s0><s1> a painting of a woman in gold and black

Prompt

<s0><s1> a painting of a woman laying on a bed with flowers

Prompt

<s0><s1> gustav klimt - woman with flowers

Prompt

<s0><s1> gustav klimt - the woman with the golden dress

Prompt

<s0><s1> the woman with the snake by gustav klimt

Prompt

<s0><s1> gustav klimt - the mother and child

Prompt

<s0><s1> gustav klimt - the nymphs

Model description

These are davidrd123/gustaveklimt2 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.

Download model

Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke

LoRA: download gustaveklimt2.safetensors here 💾.
- Place it on your models/Lora folder.
- On AUTOMATIC1111, load the LoRA by adding <lora:gustaveklimt2:1> to your prompt. On ComfyUI just load it as a regular LoRA.
Embeddings: download gustaveklimt2_emb.safetensors here 💾.
- Place it on it on your embeddings folder
- Use it by adding gustaveklimt2_emb to your prompt. (you need both the LoRA and the embeddings as they were trained together for this LoRA)

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch
from huggingface_hub import hf_hub_download
from safetensors.torch import load_file
        
pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('davidrd123/gustaveklimt2', weight_name='pytorch_lora_weights.safetensors')
embedding_path = hf_hub_download(repo_id='davidrd123/gustaveklimt2', filename='gustaveklimt2_emb.safetensors' repo_type="model")
state_dict = load_file(embedding_path)
pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
pipeline.load_textual_inversion(state_dict["clip_g"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder_2, tokenizer=pipeline.tokenizer_2)
        
image = pipeline('<s0><s1>').images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers

Trigger words

To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:

to trigger concept TOK → use <s0><s1> in your prompt

Details

All Files & versions.

The weights were trained using 🧨 diffusers Advanced Dreambooth Training Script.

LoRA for the text encoder was enabled. False.

Pivotal tuning was enabled: True.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.