Update Readme
Browse files
README.md
CHANGED
|
@@ -27,10 +27,18 @@ See [Github Page](https://github.com/baaivision/tokenize-anything).
|
|
| 27 |
|
| 28 |
Two versions of the model are available with different image encoders.
|
| 29 |
|
| 30 |
-
| Model | Description | MD5 | Weights |
|
| 31 |
-
| ----- | ------------| ----| ------ |
|
| 32 |
-
| **tap_vit_l** | ViT-L TAP model |
|
| 33 |
-
| **tap_vit_b** | ViT-B TAP model |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
### Concept weights
|
| 36 |
|
|
|
|
| 27 |
|
| 28 |
Two versions of the model are available with different image encoders.
|
| 29 |
|
| 30 |
+
| Model | Description | Schedule | MD5 | Weights |
|
| 31 |
+
| ----- | ------------| ------ | ----| ------ |
|
| 32 |
+
| **tap_vit_l** | ViT-L TAP v1.1 model | (100% SA-1B, 180k), (VG, 50ep) | c1d41f | [🤗 HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_v1_1.pkl) |
|
| 33 |
+
| **tap_vit_b** | ViT-B TAP v1.1 model | (100% SA-1B, 180k), (VG, 50ep) | 707f80 | [🤗 HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_v1_1.pkl) |
|
| 34 |
+
| **tap_vit_l** | ViT-L TAP v1.0 model | (50% SA-1B, 90k), (VG, 25ep) | 03f8ec | [🤗 HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_v1_0.pkl) |
|
| 35 |
+
| **tap_vit_b** | ViT-B TAP v1.0 model | (50% SA-1B, 90k), (VG, 25ep) | b45cbf | [🤗 HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_v1_0.pkl) |
|
| 36 |
+
|
| 37 |
+
#### V1.1 Release Notes
|
| 38 |
+
|
| 39 |
+
- Use a longer pre-training and fine-tuning schedule (improved segmentation and caption performance).
|
| 40 |
+
- Apply weight decay for all bias parameters (avoid FP16 overflow in QK matmul).
|
| 41 |
+
- Sample point prompts from predicted mask instead of GT box during VG training.
|
| 42 |
|
| 43 |
### Concept weights
|
| 44 |
|