Create dinov2_bert_large_results.txt

dinov2_bert_large_results.txt

@@ -0,0 +1,170 @@
+======================================================================
+STAGE 2: FULL VALIDATION BATTERY
+======================================================================
+
+Loading cached datasets...
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12921.78it/s]
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 14461.08it/s]
+  COCO train: 40504, COCO test: 40775
+
+======================================================================
+EXP 1: MAIN (5 seeds, FULL train)
+======================================================================
+
+  Seed 42:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 16096.56it/s]
+  seed_42 pretrain val (N=6076): R@1=0.0000 R@5=0.0002 cos=-0.010 CVj=0.167
+    Ep  1: loss=0.3334 c=0.2841 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.537 (37s)
+  Seed 42 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.977 CVj=0.142
+
+  Seed 123:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12929.91it/s]
+  seed_123 pretrain val (N=6076): R@1=0.0001 R@5=0.0005 cos=-0.004 CVj=0.168
+    Ep  1: loss=0.3222 c=0.2729 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.531 (36s)
+  Seed 123 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.977 CVj=0.155
+
+  Seed 456:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13957.28it/s]
+  seed_456 pretrain val (N=6076): R@1=0.0000 R@5=0.0005 cos=0.006 CVj=0.165
+    Ep  1: loss=0.3120 c=0.2628 p=0.0002 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.524 (36s)
+  Seed 456 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.975 CVj=0.151
+
+  Seed 789:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13756.42it/s]
+  seed_789 pretrain val (N=6076): R@1=0.0000 R@5=0.0010 cos=0.016 CVj=0.184
+    Ep  1: loss=0.3166 c=0.2673 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.531 (37s)
+  Seed 789 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.977 CVj=0.145
+
+  Seed 2024:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13427.47it/s]
+  seed_2024 pretrain val (N=6076): R@1=0.0005 R@5=0.0020 cos=0.004 CVj=0.159
+    Ep  1: loss=0.3293 c=0.2800 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.534 (37s)
+  Seed 2024 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.978 CVj=0.145
+
+  R@1: 1.0000 ± 0.0000
+
+======================================================================
+EXP 2: CONTRASTIVE ONLY
+======================================================================
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12913.66it/s]
+  contrastive_only pretrain val (N=6076): R@1=0.0000 R@5=0.0004 cos=-0.019 CVj=0.147
+    Ep  1: loss=0.3113 c=0.3113 p=0.0000 a=0.0000 val_R@1=1.0000 val_R@5=1.0000 temp=14.543 (20s)
+  Contrastive only (N=40775): R@1=1.0000 R@5=1.0000 cos=0.971 CVj=0.133
+
+======================================================================
+EXP 3: DEPTH (1,2,4,6 layers)
+======================================================================
+
+  1 layers:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 14139.72it/s]
+  depth_1 pretrain val (N=6076): R@1=0.0001 R@5=0.0003 cos=0.003 CVj=0.158
+    Ep  1: loss=0.2801 c=0.2308 p=0.0002 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.497 (34s)
+  1L (N=40775): R@1=1.0000 R@5=1.0000 cos=0.988 CVj=0.153
+
+  2 layers:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12575.47it/s]
+  depth_2 pretrain val (N=6076): R@1=0.0001 R@5=0.0009 cos=0.007 CVj=0.152
+    Ep  1: loss=0.2803 c=0.2310 p=0.0002 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.504 (35s)
+  2L (N=40775): R@1=1.0000 R@5=1.0000 cos=0.988 CVj=0.178
+
+  4 layers:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13950.64it/s]
+  depth_4 pretrain val (N=6076): R@1=0.0002 R@5=0.0007 cos=-0.004 CVj=0.159
+    Ep  1: loss=0.3358 c=0.2866 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.531 (37s)
+  4L (N=40775): R@1=1.0000 R@5=1.0000 cos=0.978 CVj=0.148
+
+  6 layers:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13785.95it/s]
+  depth_6 pretrain val (N=6076): R@1=0.0005 R@5=0.0009 cos=-0.001 CVj=0.147
+    Ep  1: loss=0.3918 c=0.3426 p=0.0003 a=0.9844 val_R@1=1.0000 val_R@5=1.0000 temp=14.554 (38s)
+  6L (N=40775): R@1=1.0000 R@5=1.0000 cos=0.974 CVj=0.128
+
+======================================================================
+EXP 4: SCALE (1K → FULL)
+======================================================================
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12613.29it/s]
+
+  1000 pairs:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12365.88it/s]
+  scale_1000 pretrain val (N=151): R@1=0.0066 R@5=0.0298 cos=0.002 CVj=0.213
+    Ep  1: loss=4.6368 c=4.5876 p=0.0001 a=0.9849 val_R@1=0.7583 val_R@5=0.9503 temp=14.284 (3s)
+  1000 (N=40775): R@1=0.8682 R@5=0.9725 cos=0.788 CVj=0.381
+
+  2000 pairs:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 15297.42it/s]
+  scale_2000 pretrain val (N=301): R@1=0.0000 R@5=0.0199 cos=-0.008 CVj=0.190
+    Ep  1: loss=3.5262 c=3.4770 p=0.0002 a=0.9847 val_R@1=0.9884 val_R@5=1.0000 temp=14.287 (4s)
+  2000 (N=40775): R@1=0.9918 R@5=1.0000 cos=0.900 CVj=0.394
+
+  5000 pairs:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13456.49it/s]
+  scale_5000 pretrain val (N=751): R@1=0.0027 R@5=0.0100 cos=0.002 CVj=0.222
+    Ep  1: loss=1.9448 c=1.8955 p=0.0004 a=0.9846 val_R@1=1.0000 val_R@5=1.0000 temp=14.306 (7s)
+  5000 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.966 CVj=0.300
+
+  10000 pairs:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13460.01it/s]
+  scale_10000 pretrain val (N=1501): R@1=0.0003 R@5=0.0017 cos=-0.008 CVj=0.191
+    Ep  1: loss=1.0957 c=1.0464 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.342 (11s)
+  10000 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.978 CVj=0.276
+
+  20000 pairs:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 12668.49it/s]
+  scale_20000 pretrain val (N=3001): R@1=0.0000 R@5=0.0008 cos=0.003 CVj=0.176
+    Ep  1: loss=0.5638 c=0.5145 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.415 (20s)
+  20000 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.980 CVj=0.206
+
+  40504 pairs:
+Loading dataset from disk: 100%
+ 49/49 [00:00<00:00, 13687.71it/s]
+  scale_40504 pretrain val (N=6076): R@1=0.0003 R@5=0.0017 cos=0.006 CVj=0.149
+    Ep  1: loss=0.3689 c=0.3196 p=0.0003 a=0.9845 val_R@1=1.0000 val_R@5=1.0000 temp=14.535 (36s)
+  40504 (N=40775): R@1=1.0000 R@5=1.0000 cos=0.975 CVj=0.133
+
+  Saved to /home/claude/geo_results.json
+
+======================================================================
+SUMMARY
+======================================================================
+
+  EXP 1 — Multi-seed:
+    R@1: 1.0000 ± 0.0000
+
+  EXP 2 — Ablation:
+    Contrastive only: R@1=1.0000
+    With geometric:   R@1=1.0000
+
+  EXP 3 — Depth:
+    1L (18,971,648): R@1=1.0000
+    2L (27,371,520): R@1=1.0000
+    4L (44,171,264): R@1=1.0000
+    6L (60,971,008): R@1=1.0000
+
+  EXP 4 — Scale:
+      1000: R@1=0.8682
+      2000: R@1=0.9918
+      5000: R@1=1.0000
+     10000: R@1=1.0000
+     20000: R@1=1.0000
+     40504: R@1=1.0000
+
+  Ref: chance=0.000025, CLIP~0.60 (400M pairs)
+Done.