Update README.md

README.md

@@ -107,6 +107,56 @@ grid
 ```
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/623ce1c6b66fedf374859fe7/SI5aYv2dygJn0Y12LIqqe.png)
 
+### Image-to-Image
+
+The model can be used also for image-to-image tasks. For instance, we can first generate a draft image and then further modify it. 
+
+Create draft image:
+```
+prompt      = "a vase that resembles a <leaf microstructure>, high quality" 
+num_samples = 4  
+num_rows    = 1
+
+all_images = []
+for _ in range(num_rows):
+    images = pipe(prompt, num_images_per_prompt=num_samples, num_inference_steps=50, guidance_scale=15).images
+    all_images.extend(images)
+
+grid = image_grid(all_images, num_rows, num_samples, save_individual_files=True)
+grid
+```
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/623ce1c6b66fedf374859fe7/MkOXQIpdhl_zWM3QySYMY.png)
+
+Now we use one of the images (second from left) and modify it using the image-to-image pipeline. You can get the image as follows:
+
+```
+cd generated_images
+wget
+cd ..
+```
+Now, generate:
+```
+fname='generated_images/image_grid_1-of-4__20240722_144702.png'
+init_image = Image.open(fname).convert("RGB")
+init_image = init_image.resize((768, 768))
+
+prompt      = "A vase made out of a spongy material, high quality photograph, full frame."
+num_samples = 4
+num_rows    = 1
+
+all_images = []
+for _ in range(num_rows):
+    images = img2imgpipe(prompt, image=init_image, 
+                         num_images_per_prompt=num_samples, strength=0.8, num_inference_steps=75, guidance_scale=25).images
+    all_images.extend(images)
+
+grid = image_grid(images, num_rows, num_samples, save_individual_files=True)
+grid
+```
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/623ce1c6b66fedf374859fe7/0ROO1Ob2Z-GYPepYyyAGg.png)
+
 ## Fine-tuning script 
 
 Download this script: [SD2x DreamBooth-Fine-Tune.ipynb](https://huggingface.co/lamm-mit/SD2x-leaf-inspired/resolve/main/SD2x_DreamBooth_Fine-Tune.ipynb)