realphongha commited on
Commit
bca8df2
·
verified ·
1 Parent(s): 1b14670

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -95,6 +95,11 @@ Key results:
95
  - Vocabulary: **11,424 tags**; ~1M training images; last 100K images held out as validation
96
  - Noise tags removed via `data/ignored_tags.txt`
97
 
 
 
 
 
 
98
  ## Acknowledgements
99
 
100
  - [DINOv3](https://github.com/facebookresearch/dinov3) (Meta AI) — pretrained ViT backbones (licensed under the DINOv3 License)
 
95
  - Vocabulary: **11,424 tags**; ~1M training images; last 100K images held out as validation
96
  - Noise tags removed via `data/ignored_tags.txt`
97
 
98
+ ## Future plan
99
+ - [ ] Care more about the data (de-duplication, remove noise, etc.). Current data cleaning pipeline is too basic?
100
+ - [ ] Try KD + Transfer Learning from L16 => B16/S16 models.
101
+ - [ ] Another self-attention block for the head => more semantic for the tags.
102
+
103
  ## Acknowledgements
104
 
105
  - [DINOv3](https://github.com/facebookresearch/dinov3) (Meta AI) — pretrained ViT backbones (licensed under the DINOv3 License)