Update README.md
Browse files
README.md
CHANGED
|
@@ -95,6 +95,11 @@ Key results:
|
|
| 95 |
- Vocabulary: **11,424 tags**; ~1M training images; last 100K images held out as validation
|
| 96 |
- Noise tags removed via `data/ignored_tags.txt`
|
| 97 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 98 |
## Acknowledgements
|
| 99 |
|
| 100 |
- [DINOv3](https://github.com/facebookresearch/dinov3) (Meta AI) — pretrained ViT backbones (licensed under the DINOv3 License)
|
|
|
|
| 95 |
- Vocabulary: **11,424 tags**; ~1M training images; last 100K images held out as validation
|
| 96 |
- Noise tags removed via `data/ignored_tags.txt`
|
| 97 |
|
| 98 |
+
## Future plan
|
| 99 |
+
- [ ] Care more about the data (de-duplication, remove noise, etc.). Current data cleaning pipeline is too basic?
|
| 100 |
+
- [ ] Try KD + Transfer Learning from L16 => B16/S16 models.
|
| 101 |
+
- [ ] Another self-attention block for the head => more semantic for the tags.
|
| 102 |
+
|
| 103 |
## Acknowledgements
|
| 104 |
|
| 105 |
- [DINOv3](https://github.com/facebookresearch/dinov3) (Meta AI) — pretrained ViT backbones (licensed under the DINOv3 License)
|