| --- |
| library_name: diffusers |
| base_model: stabilityai/stable-diffusion-2-1-base |
| license: apache-2.0 |
| widget: |
| - src: osm_tile_18_42048_101323.jpeg |
| prompt: Satellite image features a city neighborhood |
| tags: |
| - controlnet |
| - stable-diffusion |
| - satellite-imagery |
| - OSM |
| pipeline_tag: image-to-image |
| --- |
| |
| # Model Card for Model ID |
|
|
| <!-- Provide a quick summary of what the model is/does. --> |
| This is a ControlNet based model that synthesizes satellite images given OpenStreetMap Images. The base stable diffusion model used is [stable-diffusion-2-1-base](https://huggingface.co/stabilityai/stable-diffusion-2-1-base) (v2-1_512-ema-pruned.ckpt). |
| |
| * Use it with 🧨 [diffusers](#examples) |
| * Use it with [controlnet](https://github.com/lllyasviel/ControlNet/tree/main?tab=readme-ov-file) repository |
| |
| ### Model Sources [optional] |
| |
| <!-- Provide the basic links for the model. --> |
| |
| - **Repository:** [stable-diffusion](https://huggingface.co/stabilityai/stable-diffusion-2-1-base) |
| - **Paper:** [Adding Conditional Control to Text-to-Image Diffusion Models](https://arxiv.org/abs/2302.05543) |
| |
| ## Examples |
| |
| ```python |
| from diffusers import StableDiffusionControlNetPipeline, ControlNetModel |
| import torch |
| from PIL import Image |
| |
| img = Image.open("osm_tile_18_42048_101323.jpeg") |
| |
| controlnet = ControlNetModel.from_pretrained("MVRL/GeoSynth-OSM") |
|
|
| pipe = StableDiffusionControlNetPipeline.from_pretrained("stabilityai/stable-diffusion-2-1-base", controlnet=controlnet) |
| pipe = pipe.to("cuda:0") |
| |
| # generate image |
| generator = torch.manual_seed(10345340) |
| image = pipe( |
| "Satellite image features a city neighborhood", |
| generator=generator, |
| image=img, |
| ).images[0] |
| |
| image.save("generated_city.jpg") |
| ``` |
| |
| <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. --> |
| |
| ## Citation [optional] |
| |
| <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. --> |
| |
| **BibTeX:** |
| |
| [More Information Needed] |
| |
| **APA:** |
| |
| [More Information Needed] |
| |
| ## More Information [optional] |
| |
| [More Information Needed] |
| |
| ## Model Card Authors [optional] |
| |
| [More Information Needed] |
| |
| ## Model Card Contact |
| |
| [More Information Needed] |
