Create experiment_3_dual_teacher_output.txt

experiment_2/experiment_3_dual_teacher_output.txt

@@ -0,0 +1,66 @@
+=================================================================
+DUAL-TEACHER PROCRUSTES CONSENSUS DISTILLATION
+=================================================================
+  Device: cuda
+
+  Generating data...
+  Train: 15,000  Val: 3,000
+
+=================================================================
+STAGE 1A: TEACHER A — Raw Adam
+=================================================================
+  [A] E 1: t=0.073 v=0.200 cv=1.3069
+  [A] E10: t=0.612 v=0.613 cv=1.4364
+  [A] E20: t=0.655 v=0.590 cv=1.4770
+  [A] E30: t=0.690 v=0.699 cv=1.3797
+
+=================================================================
+STAGE 1B: TEACHER B — Geometric (+spr+ort)
+=================================================================
+  [B] E 1: t=0.072 v=0.184 cv=1.4589
+  [B] E10: t=0.578 v=0.606 cv=1.5603
+  [B] E20: t=0.614 v=0.667 cv=1.5950
+  [B] E30: t=0.658 v=0.649 cv=1.8004
+
+=================================================================
+STAGE 2: EXTRACT + PROCRUSTES ALIGN
+=================================================================
+  Teacher A embeddings: torch.Size([15000, 768])
+  Teacher B embeddings: torch.Size([15000, 768])
+  Raw cos(A, B): 0.4360
+  GPA iter 1: delta=0.12673541
+  GPA iter 5: delta=0.01321763
+  GPA iter 10: delta=0.00224325
+  cos(consensus, a): 0.8251
+  cos(consensus, b): 0.8226
+  Consensus CV: 0.1774
+  Consensus anchors: torch.Size([30, 768])
+  Teacher A anchors cos: 0.0008
+  Teacher B anchors cos: -0.0160
+
+=================================================================
+STAGE 3: STUDENT — Consensus distillation + classification
+=================================================================
+  E 1: t=0.081 v=0.203 cos=0.230 cv=1.1871 rig=4.8/34.4 [polygon=0.04 curve=0.00 star=0.36 structure=0.35]
+  E 5: t=0.610 v=0.618 cos=0.451 cv=0.6686 rig=12.9/98.8 [polygon=0.38 curve=0.83 star=0.67 structure=0.70]
+  E10: t=0.660 v=0.659 cos=0.550 cv=0.5453 rig=15.5/99.6 [polygon=0.41 curve=0.94 star=0.71 structure=0.72]
+  E15: t=0.711 v=0.702 cos=0.625 cv=0.4492 rig=18.7/97.8 [polygon=0.39 curve=0.88 star=0.93 structure=0.76]
+  E20: t=0.735 v=0.703 cos=0.671 cv=0.4598 rig=18.8/96.4 [polygon=0.45 curve=1.00 star=0.84 structure=0.70]
+  E25: t=0.745 v=0.736 cos=0.693 cv=0.4261 rig=18.3/92.9 [polygon=0.48 curve=1.00 star=0.92 structure=0.73]
+  E30: t=0.763 v=0.761 cos=0.704 cv=0.3359 rig=17.9/90.4 [polygon=0.50 curve=0.98 star=0.97 structure=0.76]
+
+=================================================================
+FINAL COMPARISON
+=================================================================
+
+  Model            v_acc      cv  poly curve  star struct
+  -------------------------------------------------------
+  Teacher_A        0.699  1.4312  0.42  0.99  0.83  0.72
+  Teacher_B        0.649  1.5969  0.38  0.95  0.79  0.66
+  Student          0.761  0.3329  0.50  0.98  0.97  0.76
+
+  Student anchor drift from consensus: mean=0.4458 max=0.6453
+
+=================================================================
+DONE
+=================================================================