Create noise_test_d128.txt
Browse files- noise_test_d128.txt +122 -0
noise_test_d128.txt
ADDED
|
@@ -0,0 +1,122 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
======================================================================
|
| 2 |
+
CV SPECTRUM β EMPIRICAL GEOMETRY TEST
|
| 3 |
+
Device: cuda
|
| 4 |
+
Pentachoron samples: 2000 per measurement
|
| 5 |
+
======================================================================
|
| 6 |
+
|
| 7 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 8 |
+
TEST 1: Uniform random on S^(d-1)
|
| 9 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 10 |
+
dim n_pts CV time
|
| 11 |
+
8 10000 0.3544 1.2s
|
| 12 |
+
16 10000 0.2017 0.4s β BAND
|
| 13 |
+
32 10000 0.1269 0.4s
|
| 14 |
+
64 10000 0.0847 0.4s
|
| 15 |
+
128 10000 0.0582 0.4s
|
| 16 |
+
256 10000 0.0400 0.4s
|
| 17 |
+
384 10000 0.0330 0.4s
|
| 18 |
+
512 10000 0.0287 0.4s
|
| 19 |
+
768 10000 0.0226 0.4s
|
| 20 |
+
1024 10000 0.0196 0.5s
|
| 21 |
+
|
| 22 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 23 |
+
TEST 2: Sample count sweep (d=128)
|
| 24 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 25 |
+
dim n_pts CV time
|
| 26 |
+
128 500 0.0582 0.4s
|
| 27 |
+
128 1000 0.0583 0.4s
|
| 28 |
+
128 2000 0.0603 0.4s
|
| 29 |
+
128 5000 0.0585 0.4s
|
| 30 |
+
128 10000 0.0575 0.4s
|
| 31 |
+
128 25000 0.0558 0.4s
|
| 32 |
+
128 50000 0.0587 0.4s
|
| 33 |
+
128 100000 0.0569 0.5s
|
| 34 |
+
|
| 35 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 36 |
+
TEST 3: Clustered on sphere (d=128, n=10000)
|
| 37 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 38 |
+
clusters spread CV time
|
| 39 |
+
2 0.3 0.0688 0.4s
|
| 40 |
+
5 0.3 0.0644 0.4s
|
| 41 |
+
10 0.3 0.0629 0.4s
|
| 42 |
+
20 0.3 0.0611 0.4s
|
| 43 |
+
50 0.3 0.0573 0.4s
|
| 44 |
+
100 0.3 0.0577 0.4s
|
| 45 |
+
500 0.3 0.0576 0.4s
|
| 46 |
+
1000 0.3 0.0578 0.4s
|
| 47 |
+
|
| 48 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 49 |
+
TEST 4: Cluster spread sweep (d=128, 10 clusters)
|
| 50 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 51 |
+
spread CV time
|
| 52 |
+
0.010 1.0863 0.4s
|
| 53 |
+
0.050 0.3801 0.4s
|
| 54 |
+
0.100 0.1525 0.4s
|
| 55 |
+
0.200 0.0704 0.4s
|
| 56 |
+
0.300 0.0616 0.4s
|
| 57 |
+
0.500 0.0599 0.4s
|
| 58 |
+
0.700 0.0599 0.4s
|
| 59 |
+
1.000 0.0584 0.4s
|
| 60 |
+
2.000 0.0570 0.4s
|
| 61 |
+
5.000 0.0569 0.4s
|
| 62 |
+
|
| 63 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 64 |
+
TEST 5: Anchor-attracted (d=128, n=10000)
|
| 65 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 66 |
+
n_anchors CV time
|
| 67 |
+
4 0.0822 0.4s
|
| 68 |
+
8 0.0743 0.4s
|
| 69 |
+
16 0.0678 0.4s
|
| 70 |
+
32 0.0641 0.4s
|
| 71 |
+
64 0.0595 0.4s
|
| 72 |
+
128 0.0608 0.4s
|
| 73 |
+
256 0.0575 0.4s
|
| 74 |
+
|
| 75 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 76 |
+
TEST 6: Simulated contrastive training (d=128)
|
| 77 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 78 |
+
n_clusters steps CV time
|
| 79 |
+
5 200 1.6637 0.6s
|
| 80 |
+
10 200 0.9406 0.8s
|
| 81 |
+
50 200 0.3459 2.2s
|
| 82 |
+
100 200 0.2451 4.0s β BAND
|
| 83 |
+
|
| 84 |
+
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββοΏ½οΏ½ββββββ
|
| 85 |
+
TEST 7: Contrastive sim across dimensions (10 clusters, 200 steps)
|
| 86 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 87 |
+
dim CV time
|
| 88 |
+
16 0.9263 0.8s
|
| 89 |
+
32 0.9604 0.8s
|
| 90 |
+
64 0.9326 0.8s
|
| 91 |
+
128 0.9408 0.8s
|
| 92 |
+
256 0.9358 0.8s
|
| 93 |
+
512 0.9252 0.8s
|
| 94 |
+
|
| 95 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 96 |
+
TEST 8: 100K points β uniform vs clustered vs contrastive
|
| 97 |
+
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 98 |
+
name CV time
|
| 99 |
+
uniform_100k 0.0586 1.1s
|
| 100 |
+
clustered_10_100k 0.0623 1.1s
|
| 101 |
+
clustered_100_100k 0.0580 1.1s
|
| 102 |
+
anchored_64_100k 0.0602 1.1s
|
| 103 |
+
|
| 104 |
+
======================================================================
|
| 105 |
+
SUMMARY
|
| 106 |
+
======================================================================
|
| 107 |
+
Tests in CV band [0.18, 0.27]: 2/57
|
| 108 |
+
Tests outside band: 55/57
|
| 109 |
+
|
| 110 |
+
CV by test type:
|
| 111 |
+
100k : mean=0.0598 std=0.0017 range=[0.0580, 0.0623] in_band=0/4
|
| 112 |
+
anchored : mean=0.0666 std=0.0083 range=[0.0575, 0.0822] in_band=0/7
|
| 113 |
+
clustered : mean=0.0610 std=0.0039 range=[0.0573, 0.0688] in_band=0/8
|
| 114 |
+
contrastive : mean=0.7988 std=0.5657 range=[0.2451, 1.6637] in_band=1/4
|
| 115 |
+
contrastive_dim : mean=0.9368 std=0.0118 range=[0.9252, 0.9604] in_band=0/6
|
| 116 |
+
n_sweep : mean=0.0580 std=0.0012 range=[0.0558, 0.0603] in_band=0/8
|
| 117 |
+
spread : mean=0.2043 std=0.3092 range=[0.0569, 1.0863] in_band=0/10
|
| 118 |
+
uniform : mean=0.0970 std=0.1016 range=[0.0196, 0.3544] in_band=1/10
|
| 119 |
+
|
| 120 |
+
======================================================================
|
| 121 |
+
DONE
|
| 122 |
+
======================================================================
|