Create soup_maker_output.txt
Browse files- soup_maker_output.txt +57 -0
soup_maker_output.txt
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
=================================================================
|
| 2 |
+
BASE TIER PATCHWORK SOUP
|
| 3 |
+
3 experts Γ 768-d β 256 anchors Γ 128-d
|
| 4 |
+
Device: cuda
|
| 5 |
+
=================================================================
|
| 6 |
+
|
| 7 |
+
=================================================================
|
| 8 |
+
LOADING DATA
|
| 9 |
+
=================================================================
|
| 10 |
+
Train: 118,287 Val: 5,000
|
| 11 |
+
clip_l14_openai loaded
|
| 12 |
+
dinov2_b14 loaded
|
| 13 |
+
siglip_b16_384 loaded
|
| 14 |
+
|
| 15 |
+
=================================================================
|
| 16 |
+
BUILDING MODEL
|
| 17 |
+
=================================================================
|
| 18 |
+
Parameters:
|
| 19 |
+
projectors : 296,064
|
| 20 |
+
constellation : 32,768
|
| 21 |
+
patchwork : 100,864
|
| 22 |
+
classifier : 370,256
|
| 23 |
+
total : 799,952
|
| 24 |
+
|
| 25 |
+
=================================================================
|
| 26 |
+
TRAINING
|
| 27 |
+
20 epochs, lr=0.001, batch=128
|
| 28 |
+
Adam, no weight decay (geometry IS the regularization)
|
| 29 |
+
=================================================================
|
| 30 |
+
E 1: mAP=0.732 F1=0.609 cv=0.4301 agree=[0.977,0.986,0.974] loss=0.0845 β
|
| 31 |
+
E 2: mAP=0.768 F1=0.679 cv=0.4308 agree=[0.982,0.988,0.980] loss=0.0521 β
|
| 32 |
+
E 3: mAP=0.783 F1=0.726 cv=0.4158 agree=[0.984,0.988,0.981] loss=0.0485 β
|
| 33 |
+
E 4: mAP=0.787 F1=0.714 cv=0.3889 agree=[0.986,0.989,0.982] loss=0.0465 β
|
| 34 |
+
E 5: mAP=0.799 F1=0.742 cv=0.3760 agree=[0.987,0.989,0.983] loss=0.0453 β
|
| 35 |
+
E 6: mAP=0.805 F1=0.738 cv=0.3849 agree=[0.987,0.989,0.983] loss=0.0444 β
|
| 36 |
+
E 7: mAP=0.804 F1=0.737 cv=0.4140 agree=[0.988,0.989,0.984] loss=0.0437
|
| 37 |
+
E 8: mAP=0.806 F1=0.748 cv=0.3945 agree=[0.989,0.989,0.984] loss=0.0432 β
|
| 38 |
+
E 9: mAP=0.807 F1=0.735 cv=0.3855 agree=[0.988,0.989,0.984] loss=0.0427 β
|
| 39 |
+
E10: mAP=0.809 F1=0.751 cv=0.3396 agree=[0.989,0.989,0.985] loss=0.0423 β
|
| 40 |
+
E11: mAP=0.815 F1=0.746 cv=0.4014 agree=[0.989,0.989,0.985] loss=0.0417 β
|
| 41 |
+
E12: mAP=0.812 F1=0.729 cv=0.3759 agree=[0.989,0.989,0.985] loss=0.0414
|
| 42 |
+
E13: mAP=0.818 F1=0.750 cv=0.3313 agree=[0.990,0.990,0.986] loss=0.0411 β
|
| 43 |
+
E14: mAP=0.817 F1=0.742 cv=0.3890 agree=[0.990,0.989,0.985] loss=0.0408
|
| 44 |
+
E15: mAP=0.818 F1=0.749 cv=0.3872 agree=[0.990,0.989,0.985] loss=0.0405 β
|
| 45 |
+
E16: mAP=0.816 F1=0.746 cv=0.3667 agree=[0.990,0.990,0.986] loss=0.0402
|
| 46 |
+
E17: mAP=0.824 F1=0.753 cv=0.3517 agree=[0.990,0.989,0.985] loss=0.0399 β
|
| 47 |
+
E18: mAP=0.818 F1=0.747 cv=0.3221 agree=[0.990,0.990,0.986] loss=0.0397
|
| 48 |
+
E19: mAP=0.825 F1=0.746 cv=0.3117 agree=[0.990,0.989,0.985] loss=0.0396 β
|
| 49 |
+
E20: mAP=0.816 F1=0.738 cv=0.3320 agree=[0.990,0.990,0.986] loss=0.0392
|
| 50 |
+
|
| 51 |
+
Best mAP: 0.825
|
| 52 |
+
Model: 799,952 params
|
| 53 |
+
Anchors: 256 Γ 128-d
|
| 54 |
+
|
| 55 |
+
=================================================================
|
| 56 |
+
DONE
|
| 57 |
+
=================================================================
|