y label 1 \textbf{Controls} 2 random weights, ViT-S/16 3 DINOv2 ViT-S/14 (natural images) 4 ResNet-50, ImageNet (Aug.) 5.6 \textbf{Ours: ssl-vits16} 6.6 ssl-vits16 step 5k 7.6 ssl-vits16 step 20k 8.6 ssl-vits16 step 35k 9.6 ssl-vits16 step 40k 10.6 ssl-vits16 step 45k 11.6 ssl-vits16 step 50k 12.6 ssl-vits16 step 55k 13.6 ssl-vits16 step 60k 14.6 ssl-vits16 step 65k 15.6 ssl-vits16 final (93k) 17.2 \textbf{Ours: ssl-vitb16} 18.2 ssl-vitb16 step 10k 19.2 ssl-vitb16 step 35k 20.2 ssl-vitb16 step 40k 21.8 \textbf{Ours: distilled students} 22.8 D13: Midnight-12k teacher, 20k steps 23.8 D14: H-optimus-0 teacher, 20k steps 24.8 D15: Midnight, 5k, from random 25.8 D15: Midnight, 5k, from step 50k 26.8 D15: Midnight, 5k, from final 27.8 D16: H-optimus-0, 5k, from random 28.8 D16: H-optimus-0, 5k, from step 50k 29.8 \textbf{\textcolor{hrBest}{D16: H-optimus-0, 5k, from final}} 31.4 \textbf{Ours: ViT-B/16 students} 32.4 D18: H-optimus-0, ViT-B/16, 5k, from step 40k 33.4 D18: H-optimus-0, ViT-B/16, 5k, from step 45k 34.4 D18: H-optimus-0, ViT-B/16, 5k, from step 50k 36 \textbf{Released encoders} 37 Hibou-B (Aug.) 38 Phikon v1, ViT-B/16 (Aug.) 39 Virchow2 (Aug.) 40 Midnight-12k, CLS 41 Midnight-12k, CLS+mean 42 Midnight-12k, CLS, 1.0\,\textmu m/px 43 H-optimus-0, ImageNet norm. (Aug.) 44 H-optimus-0, ImageNet norm. (Sep.) 45 H-optimus-0, card norm., CLS 46 H-optimus-0, card norm., CLS+mean 47 H-optimus-0, card norm., CLS, 1.0\,\textmu m/px