taewhan commited on
Commit
5516ae9
·
verified ·
1 Parent(s): 6050c21

docs: add training-data scale (~0.47B samples, 96% image / 4% video) + data-efficiency vs DINOv3 LVD-1689M

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -79,6 +79,7 @@ with torch.inference_mode():
79
  | Video tokenizer | 3D Conv, tubelet size 2 |
80
  | Precision | bf16 weights |
81
  | Training | DINO + iBOT + KoLeo self-distillation, Gram anchoring, contrastive caption alignment |
 
82
 
83
  Outputs (`BaseModelOutputWithPooling`): `last_hidden_state` `(B, 1+4+N, 4096)`,
84
  `pooler_output` `(B, 4096)`.
@@ -101,8 +102,12 @@ better for every column **except KITTI depth MSE** (lower is better). Best value
101
  reflecting the encoder's dense, temporally-coherent patch features on video.
102
  - **ImageNet-1K linear probe (87.2)** and **ADE20K semantic segmentation (52.0 mIoU)** are
103
  second only to DINOv3 7B while ahead of DINOv2, V-JEPA 2.1, and SigLIP2.
 
 
 
 
104
  - K400 action recognition and KITTI depth estimation are still being evaluated and will be added
105
- as the runs complete.
106
 
107
  Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
108
  video. Comparison numbers are the best figures reported by each model's authors.
 
79
  | Video tokenizer | 3D Conv, tubelet size 2 |
80
  | Precision | bf16 weights |
81
  | Training | DINO + iBOT + KoLeo self-distillation, Gram anchoring, contrastive caption alignment |
82
+ | Training data | ~0.47B samples — 448.6M images (96%) + 18.5M video clips (4%) |
83
 
84
  Outputs (`BaseModelOutputWithPooling`): `last_hidden_state` `(B, 1+4+N, 4096)`,
85
  `pooler_output` `(B, 4096)`.
 
102
  reflecting the encoder's dense, temporally-coherent patch features on video.
103
  - **ImageNet-1K linear probe (87.2)** and **ADE20K semantic segmentation (52.0 mIoU)** are
104
  second only to DINOv3 7B while ahead of DINOv2, V-JEPA 2.1, and SigLIP2.
105
+ - **Data efficiency** — these results come from **~0.47B training samples** (448.6M images +
106
+ 18.5M video clips), roughly **3.6× less data than DINOv3**, which is trained on LVD-1689M
107
+ (1,689M images). Despite the smaller corpus — and with only ~4% of samples being video — the
108
+ encoder stays competitive across both image and video benchmarks, and leads on DAVIS.
109
  - K400 action recognition and KITTI depth estimation are still being evaluated and will be added
110
+ as the runs complete. Numbers in this table will be updated as evaluations finish.
111
 
112
  Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
113
  video. Comparison numbers are the best figures reported by each model's authors.