mjbuehler commited on
Commit
f15c70c
·
verified ·
1 Parent(s): 512736e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -13,12 +13,20 @@ instance_prompt: <leaf microstructure>
13
  widget: []
14
  ---
15
 
16
- # Stable Diffusion 2.x Fine-tuned with Leaf Images
 
 
 
 
 
 
17
 
18
  ## Model description
19
 
20
  These are fine-tuned weights for the ```stabilityai/stable-diffusion-2``` model. This is a full fine-tune of the model using DreamBooth.
21
 
 
 
22
  ## Trigger keywords
23
 
24
  The following image were used during fine-tuning using the keyword \<leaf microstructure\>:
 
13
  widget: []
14
  ---
15
 
16
+ # Stable Diffusion 2.x Fine-tuned with Leaf Images
17
+
18
+ DreamBooth is an advanced technique designed for fine-tuning text-to-image diffusion models to generate personalized images of specific subjects.
19
+
20
+ By leveraging a few reference images (around 5 or so), DreamBooth integrates unique visual features of the subject into the model's output domain.
21
+
22
+ This is achieved by binding a unique identifier "<..IDENTIFIER..>", such as <leaf microstructure> in this work, to the subject. An optional class-specific prior preservation loss can be used to maintain high fidelity and contextual diversity. The result is a model capable of synthesizing novel, photorealistic images of the subject in various scenes, poses, and lighting conditions, guided by text prompts. In this project, DreamBooth has been applied to render images with specific biological patterns, making it ideal for applications in materials science and engineering where accurate representation of biological material microstructures is crucial.
23
 
24
  ## Model description
25
 
26
  These are fine-tuned weights for the ```stabilityai/stable-diffusion-2``` model. This is a full fine-tune of the model using DreamBooth.
27
 
28
+
29
+
30
  ## Trigger keywords
31
 
32
  The following image were used during fine-tuning using the keyword \<leaf microstructure\>: