Text-to-Image
Diffusers
diffusers-training
lora
template:sd-lora
stable-diffusion-xl
stable-diffusion-xl-diffusers
Instructions to use hbiny/4_text2img with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use hbiny/4_text2img with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("hbiny/4_text2img") prompt = "d0nar1dk, salute" image = pipe(prompt).images[0] - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
End of training
Browse files- .gitattributes +3 -0
- README.md +74 -0
- checkpoint-150/optimizer.bin +3 -0
- checkpoint-150/pytorch_lora_weights.safetensors +3 -0
- checkpoint-150/random_states_0.pkl +3 -0
- checkpoint-150/scheduler.bin +3 -0
- checkpoint-300/optimizer.bin +3 -0
- checkpoint-300/pytorch_lora_weights.safetensors +3 -0
- checkpoint-300/random_states_0.pkl +3 -0
- checkpoint-300/scheduler.bin +3 -0
- checkpoint-450/optimizer.bin +3 -0
- checkpoint-450/pytorch_lora_weights.safetensors +3 -0
- checkpoint-450/random_states_0.pkl +3 -0
- checkpoint-450/scheduler.bin +3 -0
- checkpoint-600/optimizer.bin +3 -0
- checkpoint-600/pytorch_lora_weights.safetensors +3 -0
- checkpoint-600/random_states_0.pkl +3 -0
- checkpoint-600/scheduler.bin +3 -0
- checkpoint-750/optimizer.bin +3 -0
- checkpoint-750/pytorch_lora_weights.safetensors +3 -0
- checkpoint-750/random_states_0.pkl +3 -0
- checkpoint-750/scheduler.bin +3 -0
- checkpoint-900/optimizer.bin +3 -0
- checkpoint-900/pytorch_lora_weights.safetensors +3 -0
- checkpoint-900/random_states_0.pkl +3 -0
- checkpoint-900/scheduler.bin +3 -0
- image_0.png +0 -0
- image_1.png +3 -0
- image_2.png +3 -0
- image_3.png +3 -0
- pytorch_lora_weights.safetensors +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
image_1.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
image_2.png filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
image_3.png filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,74 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
license: openrail++
|
| 5 |
+
instance_prompt: d0nar1dk, blue cloth, red ribbon, yellow feet
|
| 6 |
+
widget:
|
| 7 |
+
- text: d0nar1dk, salute
|
| 8 |
+
output:
|
| 9 |
+
url: image_0.png
|
| 10 |
+
- text: d0nar1dk, salute
|
| 11 |
+
output:
|
| 12 |
+
url: image_1.png
|
| 13 |
+
- text: d0nar1dk, salute
|
| 14 |
+
output:
|
| 15 |
+
url: image_2.png
|
| 16 |
+
- text: d0nar1dk, salute
|
| 17 |
+
output:
|
| 18 |
+
url: image_3.png
|
| 19 |
+
tags:
|
| 20 |
+
- text-to-image
|
| 21 |
+
- text-to-image
|
| 22 |
+
- diffusers-training
|
| 23 |
+
- diffusers
|
| 24 |
+
- lora
|
| 25 |
+
- template:sd-lora
|
| 26 |
+
- stable-diffusion-xl
|
| 27 |
+
- stable-diffusion-xl-diffusers
|
| 28 |
+
---
|
| 29 |
+
|
| 30 |
+
<!-- This model card has been generated automatically according to the information the training script had access to. You
|
| 31 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 32 |
+
|
| 33 |
+
|
| 34 |
+
# SDXL LoRA DreamBooth - hbiny/4_text2img
|
| 35 |
+
|
| 36 |
+
<Gallery />
|
| 37 |
+
|
| 38 |
+
## Model description
|
| 39 |
+
|
| 40 |
+
These are hbiny/4_text2img LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
|
| 41 |
+
|
| 42 |
+
The weights were trained using [DreamBooth](https://dreambooth.github.io/).
|
| 43 |
+
|
| 44 |
+
LoRA for the text encoder was enabled: False.
|
| 45 |
+
|
| 46 |
+
Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
|
| 47 |
+
|
| 48 |
+
## Trigger words
|
| 49 |
+
|
| 50 |
+
You should use d0nar1dk, blue cloth, red ribbon, yellow feet to trigger the image generation.
|
| 51 |
+
|
| 52 |
+
## Download model
|
| 53 |
+
|
| 54 |
+
Weights for this model are available in Safetensors format.
|
| 55 |
+
|
| 56 |
+
[Download](hbiny/4_text2img/tree/main) them in the Files & versions tab.
|
| 57 |
+
|
| 58 |
+
|
| 59 |
+
|
| 60 |
+
## Intended uses & limitations
|
| 61 |
+
|
| 62 |
+
#### How to use
|
| 63 |
+
|
| 64 |
+
```python
|
| 65 |
+
# TODO: add an example code snippet for running this diffusion pipeline
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
#### Limitations and bias
|
| 69 |
+
|
| 70 |
+
[TODO: provide examples of latent issues and potential remediations]
|
| 71 |
+
|
| 72 |
+
## Training details
|
| 73 |
+
|
| 74 |
+
[TODO: describe the data used to train the model]
|
checkpoint-150/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fe8448f80795c3f49c7979d253a98a42ce61b87cfc8467867cb694f4c21f128a
|
| 3 |
+
size 15133372
|
checkpoint-150/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:10b2e6d127caa5a33c96f4e2100c5adde19497a782e9a08ccec7e90aff18ba5f
|
| 3 |
+
size 11778368
|
checkpoint-150/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:346a40446f2e4bc1903f874d88e522272ef9fc27ad096d4c9f986dfd5359f001
|
| 3 |
+
size 16100
|
checkpoint-150/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d0f36e41e2134a0cb8e057035bef3a0e7ceb2166315b0342f0d0533146a770bb
|
| 3 |
+
size 1000
|
checkpoint-300/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3c1eb7638ddf326f15f259df29062624eb9a0d636e437aec6bf5dfb905aa0b39
|
| 3 |
+
size 15134460
|
checkpoint-300/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:549e5eb1263f19797a44c946794721fe0dced03c7b393abca86180e719f815d9
|
| 3 |
+
size 11778368
|
checkpoint-300/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b1a017f2c6390eb986ea29d9654b3ea8d36efbd05adaf433699f03b9884f7024
|
| 3 |
+
size 16100
|
checkpoint-300/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a5d9c73d9ca363a5c608823c4f4af2a8d508ef482dfb6c46ef474adb1c19202
|
| 3 |
+
size 1000
|
checkpoint-450/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:000bc5564c324450d498b6d54e05467544578cb1f997e633878082e5da7938e3
|
| 3 |
+
size 15134460
|
checkpoint-450/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:07a2eea71b7072ced756c928c6f0fc34d1e36df63b85f6eb1303844b362e95c1
|
| 3 |
+
size 11778368
|
checkpoint-450/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1d84c9a2e7830309931d2ced6bcc87a6e0737597f72957a6608a2d5597114b0
|
| 3 |
+
size 16100
|
checkpoint-450/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:001b7fc2b6e1686628417841c3bef363ef724048b3e8f66b960186cb4a09359e
|
| 3 |
+
size 1000
|
checkpoint-600/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:578678541197faf3b7e1f64307a1e3ed2e948ab24f9066e60aac9127b5d8a6aa
|
| 3 |
+
size 15134460
|
checkpoint-600/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:206d0d4dc5b9f1524fa5399b975b1d60ff3a89fdd291817442f6ac8086ac69d3
|
| 3 |
+
size 11778368
|
checkpoint-600/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:05a8f2a2b6c4ab2386097a660de9a30a13168b8e274ad58ccfaa39d087f15d13
|
| 3 |
+
size 16100
|
checkpoint-600/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5df842b0fa8984efb7e11f7048078fd14cc320ff382c3ff2486715e8a204a9dc
|
| 3 |
+
size 1000
|
checkpoint-750/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d66f5dc5c4989bc146a7926f27f80ae6fdae31f7dcb00ca8cfb1e62710cc4f2e
|
| 3 |
+
size 15134460
|
checkpoint-750/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e4bb809b55f724269cddfee70fc85db05e9ba8b43ee6d1919aedb21ed76a40d0
|
| 3 |
+
size 11778368
|
checkpoint-750/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:adc71dd53edf10ca70b661fb9d934285ea02573b6e8413a0e2bdae5b9deef565
|
| 3 |
+
size 16100
|
checkpoint-750/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42516625df2678a0f87de778a3f0ead58da148ac4f25fc5c6212c01a977100d6
|
| 3 |
+
size 1000
|
checkpoint-900/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5348d6d49afa99b1a7ca57863d2ac7c40cb583555fda0b4adc9e383d3e1891eb
|
| 3 |
+
size 15134460
|
checkpoint-900/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90e0db6d9ec9b7113ef79e87b5bdf11d45698fba65f2716d99fc79bfbc6ecff3
|
| 3 |
+
size 11778368
|
checkpoint-900/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:822b8dfd351d3070edeb2920a11037348cb179f5ee3d91e0709ce080fd7fe801
|
| 3 |
+
size 16100
|
checkpoint-900/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:00a50f15ce2536a59483bfd860b8abddae4b974b0ac5ffe9771378b2b3689ede
|
| 3 |
+
size 1000
|
image_0.png
ADDED
|
image_1.png
ADDED
|
Git LFS Details
|
image_2.png
ADDED
|
Git LFS Details
|
image_3.png
ADDED
|
Git LFS Details
|
pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0443652be8b38cd023cf4ed76bc5ba6a6d04d773c4c1dc5d8a7b6bdf63a374c
|
| 3 |
+
size 23390424
|