Patsorn commited on
update readme.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,9 @@
|
|
| 1 |
# Image Retrieval with Text and Sketch
|
| 2 |
-
This code is for our 2022 ECCV paper [
|
| 3 |
|
| 4 |
-
<img src="https://patsorn.me/projects/tsbir/img/teaser_web_mini.jpg" width="
|
|
|
|
|
|
|
| 5 |
|
| 6 |
---------------------
|
| 7 |
folder structure
|
|
@@ -9,24 +11,25 @@ folder structure
|
|
| 9 |
|---model/ : Contain the trained model*
|
| 10 |
|---sketches/ : Contain example query sketch
|
| 11 |
|---images/ : Contain 100 randomly sampled images from COCO TBIR benchmark
|
| 12 |
-
|---notebooks/ : Contain the demo ipynb notebook
|
| 13 |
|---code/
|
| 14 |
|---training/model_configs/ : Contain model config file for the network
|
| 15 |
|---clip/ : Contain source code for running the notebook
|
| 16 |
|
| 17 |
-
*
|
| 18 |
-
|
| 19 |
-
This repo is based on open_clip implementation from https://github.com/mlfoundations/open_clip
|
| 20 |
|
| 21 |
## Prerequisites
|
| 22 |
- Pytorch
|
| 23 |
|
| 24 |
## Getting Started
|
| 25 |
|
| 26 |
-
Simply
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
## Download Models
|
| 29 |
-
Pre-trained models
|
| 30 |
- <a href='https://patsorn.me/projects/tsbir/data/tsbir_model_final.pt' > Pre-trained models </a>
|
| 31 |
|
| 32 |
## Citation
|
|
|
|
| 1 |
# Image Retrieval with Text and Sketch
|
| 2 |
+
This code is for our 2022 ECCV paper [A Sketch Is Worth a Thousand Words: Image Retrieval with Text and Sketch](https://patsorn.me/projects/tsbir/)
|
| 3 |
|
| 4 |
+
<img src="https://patsorn.me/projects/tsbir/img/teaser_web_mini.jpg" width="800px"/>
|
| 5 |
+
|
| 6 |
+
This repo is based on open_clip implementation from https://github.com/mlfoundations/open_clip
|
| 7 |
|
| 8 |
---------------------
|
| 9 |
folder structure
|
|
|
|
| 11 |
|---model/ : Contain the trained model*
|
| 12 |
|---sketches/ : Contain example query sketch
|
| 13 |
|---images/ : Contain 100 randomly sampled images from COCO TBIR benchmark
|
| 14 |
+
|---notebooks/ : Contain the demo ipynb notebook
|
| 15 |
|---code/
|
| 16 |
|---training/model_configs/ : Contain model config file for the network
|
| 17 |
|---clip/ : Contain source code for running the notebook
|
| 18 |
|
| 19 |
+
*need to be downloaded first
|
|
|
|
|
|
|
| 20 |
|
| 21 |
## Prerequisites
|
| 22 |
- Pytorch
|
| 23 |
|
| 24 |
## Getting Started
|
| 25 |
|
| 26 |
+
- Simply open jupyter notebook in `notebooks/Retrieval_Demo.ipynb` for an example of how to retrieve images using our model,
|
| 27 |
+
|
| 28 |
+
- You can use your own set of images and sketches by modifying the `images/` and `sketches/` folder accordingly.
|
| 29 |
+
|
| 30 |
+
- Colab version of the notebook is available [[here]](https://colab.research.google.com/)
|
| 31 |
|
| 32 |
## Download Models
|
|
|
|
| 33 |
- <a href='https://patsorn.me/projects/tsbir/data/tsbir_model_final.pt' > Pre-trained models </a>
|
| 34 |
|
| 35 |
## Citation
|