Upload AlphaCLIP weights, License and README

LICENSE

@@ -0,0 +1,50 @@
+Licensing
+
+Copyright (c) 2024 Omer Regev
+
+Licensed under the MIT License (the "License") and the Commons
+Clause Restriction; you may not use this file except in compliance with the
+License and the Commons Clause Restriction.
+
+
+MIT License
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.
+
+
+Commons Clause Restriction
+“Commons Clause” License Condition v1.0
+
+The Software is provided to you by the Licensor under the License, as defined below,
+subject to the following condition. Without limiting other conditions in the License,
+the grant of rights under the License will not include, and the License does not grant to you,
+the right to Sell the Software. For purposes of the foregoing, “Sell” means practicing
+any or all of the rights granted to you under the License to provide to third parties,
+for a fee or other consideration (including without limitation fees for hosting or
+consulting/ support services related to the Software), a product or service whose value derives,
+entirely or substantially, from the functionality of the Software.
+Any license notice or attribution required by the License must also include this
+Commons Clause License Condition notice.
+
+
+
+
+
+
+

README.md

@@ -1,5 +1,94 @@
----
-license: other
-license_name: mit-license-with-commons-clause-restriction
-license_link: LICENSE
----
+# [AAAI 2025] Click2Mask: Local Editing with Dynamic Mask Generation
+
+Official PyTorch Implementation for 
+["Click2Mask: Local Editing with Dynamic Mask Generation"](https://omeregev.github.io/click2mask/).
+
+[![Website](https://img.shields.io/badge/Website-blue?style=flat&logo=github)](https://omeregev.github.io/click2mask/)
+[![arXiv](https://img.shields.io/badge/arXiv-2409.08272-b31b1b?style=flat&logo=arxiv)](https://arxiv.org/abs/2409.08272)
+[![Paper PDF](https://img.shields.io/badge/Paper-PDF-red?style=flat&logo=adobe)](https://omeregev.github.io/click2mask/static/paper/Click2Mask.pdf)
+[![GitHub Code](https://img.shields.io/badge/GitHub-555555?style=flat&logo=github&logoColor=white)](https://github.com/omeregev/click2mask)[![Code](https://img.shields.io/badge/Code-000000?style=flat&logo=github&logoColor=white)](https://github.com/omeregev/click2mask)
+[![YouTube Video](https://img.shields.io/badge/Video-YouTube-red?style=flat&logo=youtube)](https://youtu.be/A0ZEVTm9SLw?si=_coDIWRXa8Wo-2na)
+[![Hugging Face Demo](https://img.shields.io/badge/🤗%20Hugging%20Face-Demo-yellow?style=flat)](https://huggingface.co/spaces/omeregev/click2mask)
+[![Colab](https://img.shields.io/badge/Colab-Demo-orange?style=flat&logo=googlecolab)](https://colab.research.google.com/github/omeregev/click2mask/blob/main/demo.ipynb)
+<br><br>
+
+<img src="imgs/teaser.gif"/>
+
+<a href="https://omeregev.github.io/click2mask/">**[AAAI 2025] Click2Mask: Local Editing with Dynamic Mask Generation**</a>
+<br>
+<a href="https://www.linkedin.com/in/omeregev/">Omer Regev</a>,
+<a href="https://omriavrahami.com/">Omri Avrahami</a>,
+<a href="https://www.cs.huji.ac.il/~danix/">Dani Lischinski</a>
+
+Given an image, a <span style="white-space: nowrap;">
+    <b>Click</b> <img src="imgs/point.png" alt="alt text" width="10" style="margin-right: 2px;">
+</span>, and a prompt for an added object, a **Mask** is generated dynamically, 
+simultaneously with the object generation throughout the diffusion process.
+
+Current methods rely on existing objects/segments, or user effort (masks/detailed text), 
+to localize object additions. Our approach enables free-form editing, 
+where the manipulated area is not well-defined, using just a  <span style="white-space: nowrap;">
+    <b>Click</b> <img src="imgs/point.png" alt="alt text" width="10" style="margin-right: 2px;">
+</span> for localization.
+
+## 🚀 New! Try Click2Mask Online
+
+### 🤗 Hugging Face Demo
+Try it instantly in your browser - no setup required.  
+[**Launch Demo →**](https://huggingface.co/spaces/omeregev/click2mask)
+
+### <img src="https://colab.research.google.com/img/colab_favicon_256px.png" width="25" height="25" align="center"> Google Colab Demo
+Includes both Gradio interface and command line for advanced usage.  
+[**Open in Colab →**](https://colab.research.google.com/github/omeregev/click2mask/blob/main/demo.ipynb)
+
+**For additional usage options** - please refer to our [**repository**](https://github.com/omeregev/click2mask).
+
+
+## Results
+
+### Output Examples
+Each example includes an input image with a <span style="white-space: nowrap;">
+    <b>Click</b> <img src="imgs/point.png" alt="alt text" width="10" style="margin-right: 2px;">
+</span>, 
+followed by outputs corresponding to the prompts below.
+<img src="imgs/results.jpg">
+
+### Qualitative Comparisons with SoTA Methods
+A brief glimpse into the qualitative comparison between the SoTA methods — 
+[Emu Edit](https://emu-edit.metademolab.com),
+[MagicBrush](https://osu-nlp-group.github.io/MagicBrush/)
+and [InstructPix2Pix](https://timothybrooks.com/instruct-pix2pix)
+— against our model, [**Click2Mask**](https://omeregev.github.io/click2mask/). 
+<br>
+Upper prompts were given to baselines, and lower (shorter) ones to **Click2Mask**.
+Inputs contain the <span style="white-space: nowrap;">
+    <b>Click</b> <img src="imgs/point.png" alt="alt text" width="10" style="margin-right: 2px;">
+</span> given to **Click2Mask**.
+<img src="imgs/compare.png">
+
+## Evaluating Edited Regions in Maskless Methods
+We introduce **Edited Alpha-CLIP** to evaluate mask-free methods by extracting a mask of the edited region 
+and using [Alpha-CLIP](https://aleafy.github.io/alpha-clip/) to assess its alignment with the prompt.
+<br>
+Examples of mask extractions: outputs are on the left, extracted masks (green overlay) on the right.
+<img src="imgs/edited_alphaclip.png">
+
+
+## Citation
+If you find this helpful for your research, please reference the following:
+```bibtex
+@misc{regev2024click2masklocaleditingdynamic,
+      title={Click2Mask: Local Editing with Dynamic Mask Generation}, 
+      author={Omer Regev and Omri Avrahami and Dani Lischinski},
+      year={2024},
+      eprint={2409.08272},
+      archivePrefix={arXiv},
+      primaryClass={cs.CV},
+      url={https://arxiv.org/abs/2409.08272}, 
+}
+```
+
+## Acknowledgements
+This code is based on 
+[Blended Latent Diffusion](https://github.com/omriav/blended-latent-diffusion/tree/master) 
+and on [Stable Diffusion](https://github.com/CompVis/stable-diffusion).

clip_l14_336_grit1m_fultune_8xe.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa701cf18a3e19a1e5e81668885b15bf75337e59b0788405999e889b7aa775d0
+size 1218070895