Update README.md
Browse files
README.md
CHANGED
|
@@ -53,45 +53,3 @@ rewards = [[0.5811622738838196], [0.2745276093482971], [-1.4131819009780884], [-
|
|
| 53 |
3.webp: -1.41
|
| 54 |
4.webp: -2.03
|
| 55 |
```
|
| 56 |
-
|
| 57 |
-
## Test
|
| 58 |
-
|
| 59 |
-
### Setup for baselines
|
| 60 |
-
|
| 61 |
-
#### Environment
|
| 62 |
-
|
| 63 |
-
```bash
|
| 64 |
-
$ pip install git+https://github.com/openai/CLIP.git
|
| 65 |
-
```
|
| 66 |
-
|
| 67 |
-
#### Checkpoint
|
| 68 |
-
|
| 69 |
-
Models | File Paths | Download Links
|
| 70 |
-
--- | :---: | :---:
|
| 71 |
-
ImageReward | checkpoint/ | <a href="https://huggingface.co/THUDM/ImageReward/blob/main/ImageReward.pt">Download</a>
|
| 72 |
-
CLIP Score | checkpoint/clip/ | <a href="https://openaipublic.azureedge.net/clip/models/b8cca3fd41ae0c99ba7e8951adf17d267cdb84cd88be6f7c2e0eca1737a03836/ViT-L-14.pt">Download</a>
|
| 73 |
-
BLIP Score | checkpoint/blip/ | <a href="https://storage.googleapis.com/sfr-vision-language-research/BLIP/models/model_large.pth">Download</a>
|
| 74 |
-
Aesthetic | checkpoint/aesthetic/ | <a href="https://github.com/christophschuhmann/improved-aesthetic-predictor/raw/main/sac%2Blogos%2Bava1-l14-linearMSE.pth">Download</a>
|
| 75 |
-
|
| 76 |
-
#### Data
|
| 77 |
-
|
| 78 |
-
Data | File Paths | Download Links
|
| 79 |
-
--- | :---: | :---:
|
| 80 |
-
test_images | data/ | <a href="https://huggingface.co/THUDM/ImageReward/blob/main/test_images.zip">Download</a>
|
| 81 |
-
|
| 82 |
-
Download `test_images.zip` and unzip it to `data/test_images/`
|
| 83 |
-
|
| 84 |
-
### One step for test
|
| 85 |
-
|
| 86 |
-
```bash
|
| 87 |
-
$ python test.py
|
| 88 |
-
```
|
| 89 |
-
|
| 90 |
-
The test result is:
|
| 91 |
-
|
| 92 |
-
Models | Preference Acc.
|
| 93 |
-
--- | :---:
|
| 94 |
-
CLIP Score | 54.82
|
| 95 |
-
Aesthetic Score | 57.35
|
| 96 |
-
BLIP Score | 57.76
|
| 97 |
-
ImageReward (Ours) | **65.14**
|
|
|
|
| 53 |
3.webp: -1.41
|
| 54 |
4.webp: -2.03
|
| 55 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|