# Long-CLIP
This repository is the official implementation of Long-CLIP
**Long-CLIP: Unlocking the Long-Text Capability of CLIP**\
[Beichen Zhang](https://beichenzbc.github.io), [Pan Zhang](https://panzhang0212.github.io/), [Xiaoyi Dong](https://lightdxy.github.io/), [Yuhang Zang](https://yuhangzang.github.io/), [Jiaqi Wang](https://myownskyw7.github.io/)
## π‘ Highlights
- π₯ **Long Input length** Increase the maximum input length of CLIP from **77** to **248**.
- π₯ **Strong Performace** Improve the R@5 of long-caption text-image retrieval by **20%** and traditional text-image retrieval by **6%**.
- π₯ **Plug-in and play** Can be directly applied in **any work** that requires long-text capability.
## π News
π [2024/7/3] Our paper has been accepted by ***ECCV2024***.
π [2024/7/3] We release the code of using Long-CLIP in ***SDXL***. For detailed information, you may refer to `SDXL/SDXL.md`.
π [2024/5/21] We update the paper and checkpoints after fixing the bug in DDP and addβ¦
- Adding `safetensors` variant of this model (5bb31f40a202198afd0ed11af51ad49ebbcf8f3c)
Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>