AbstractPhil commited on
Commit
65038b2
Β·
verified Β·
1 Parent(s): ec4601d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +169 -3
README.md CHANGED
@@ -1,3 +1,169 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+ This version essentially imploded, and yet the geometry held the entire time through a cutmix gauntlet that could not be overcome.
5
+
6
+ ```
7
+ ======================================================================
8
+ CHAOS-NATIVE DUAL-STREAM PROBE
9
+ ======================================================================
10
+
11
+ Loading model...
12
+ Model loaded from: ./checkpoints_dualstream/20251008_163456_chaos_native/model_epoch_149.safetensors
13
+ Parameters: 41,132,926
14
+
15
+ Loading data...
16
+ Test samples: 10000
17
+ Probe samples: 5000
18
+
19
+ ======================================================================
20
+ PROBE 1: Dual-Stream Analysis
21
+ ======================================================================
22
+
23
+ [1.1] Extracting stream features...
24
+ Extracting: 0%| | 0/40 [00:00<?, ?it/s]
25
+ Model output keys: ['logits', 'visual_features', 'geometric_features', 'pe_features', 'cantor_measure', 'visual_stream', 'geometric_stream']
26
+ logits: torch.Size([128, 100])
27
+ visual_features: torch.Size([128, 512])
28
+ geometric_features: torch.Size([128, 256])
29
+ pe_features: torch.Size([65, 24])
30
+ cantor_measure: torch.Size([65])
31
+ visual_stream: torch.Size([128, 65, 512])
32
+ geometric_stream: torch.Size([128, 8, 256])
33
+ Extracting: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 40/40 [00:02<00:00, 18.99it/s]
34
+
35
+ Visual features shape: (5000, 100)
36
+ Geometric features shape: (5000, 256)
37
+
38
+ [1.2] Analyzing stream dimensionality...
39
+ Visual stream: 1/100 dims for 90% variance
40
+ Geometric stream: 1/256 dims for 90% variance
41
+ Visual intrinsic dim: 1.04
42
+ Geometric intrinsic dim: 1.01
43
+
44
+ [1.3] Measuring stream independence...
45
+ Mean abs correlation: 0.2077
46
+ Max abs correlation: 0.9985
47
+ Interpretation: Independent
48
+
49
+ [1.4] Testing class separability per stream...
50
+ Visual stream probe: 0.0227
51
+ Geometric stream probe: 0.0227
52
+ Visual advantage: +0.0000
53
+
54
+ ======================================================================
55
+ PROBE 2: Geometric Stream Health
56
+ ======================================================================
57
+
58
+ [2.1] Collecting geometric health metrics...
59
+ Health metrics: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 40/40 [00:02<00:00, 18.90it/s]
60
+
61
+ Token Diversity: 0.2820 Β± 0.0025
62
+ Feature Diversity: 1.3960 Β± 0.0029
63
+ Mean Norm: 22.2937 Β± 0.0464
64
+ Status: βœ“ Healthy
65
+
66
+ ======================================================================
67
+ PROBE 3: Chaos Tolerance (CutMix Robustness)
68
+ ======================================================================
69
+
70
+ [3.0] Testing alpha=0.0...
71
+ Accuracy: 0.0221
72
+ Geometric mean norm: 22.2951
73
+
74
+ [3.2] Testing alpha=0.2...
75
+ Accuracy: 0.0173
76
+ Geometric mean norm: 22.3495
77
+
78
+ [3.5] Testing alpha=0.5...
79
+ Accuracy: 0.0165
80
+ Geometric mean norm: 22.3517
81
+
82
+ [3.10] Testing alpha=1.0...
83
+ Accuracy: 0.0174
84
+ Geometric mean norm: 22.3580
85
+
86
+ [3.15] Testing alpha=1.5...
87
+ Accuracy: 0.0161
88
+ Geometric mean norm: 22.3592
89
+
90
+ [3.20] Testing alpha=2.0...
91
+ Accuracy: 0.0164
92
+ Geometric mean norm: 22.3624
93
+
94
+ Clean accuracy (Ξ±=0.0): 0.0221
95
+ Extreme chaos (Ξ±=2.0): 0.0164
96
+ Chaos tolerance: 74.21%
97
+ Interpretation: Good
98
+
99
+ ======================================================================
100
+ PROBE 4: Clean vs Mixed Image Analysis
101
+ ======================================================================
102
+
103
+ [4.1] Testing on clean images...
104
+ Accuracy: 0.0221
105
+ Mean confidence: 0.0120
106
+
107
+ [4.2] Testing on mixed images (Ξ±=1.0)...
108
+ Accuracy: 0.0160
109
+ Mean confidence: 0.0106
110
+
111
+ Performance gap: 0.0061
112
+ Confidence gap: 0.0014
113
+ Adaptation: Strong
114
+
115
+ ======================================================================
116
+ PROBE 5: Geometric Stream Stability
117
+ ======================================================================
118
+
119
+ [5.1] Testing Gaussian noise robustness...
120
+ Noise Οƒ=0.0: norm=22.2937
121
+ Noise Οƒ=0.1: norm=22.2945
122
+ Noise Οƒ=0.2: norm=22.2965
123
+ Noise Οƒ=0.3: norm=22.2948
124
+
125
+ [5.2] Testing CutMix stability...
126
+ Norm range across CutMix: 0.0704
127
+ Status: βœ“ Stable
128
+
129
+ ======================================================================
130
+ Results saved to: probe_chaos_results/chaos_probe_results.json
131
+ ======================================================================
132
+
133
+ ======================================================================
134
+ Generating visualizations...
135
+ ======================================================================
136
+
137
+ [Viz 1] Chaos tolerance curve...
138
+ [Viz 2] Stream correlation heatmap...
139
+ [Viz 3] Geometric stability...
140
+
141
+ Visualizations saved to: probe_chaos_results
142
+
143
+ ======================================================================
144
+ CHAOS-NATIVE PROBE SUMMARY
145
+ ======================================================================
146
+
147
+ [Dual-Stream Analysis]
148
+ Visual intrinsic dim: 1.04
149
+ Geometric intrinsic dim: 1.01
150
+ Stream independence: 0.2077
151
+
152
+ [Geometric Health]
153
+ Mean norm: 22.2937
154
+ Token diversity: 0.2820
155
+
156
+ [Chaos Tolerance]
157
+ Clean accuracy: 0.0221
158
+ Max chaos accuracy: 0.0164
159
+ Tolerance score: 74.21%
160
+
161
+ [Clean vs Mixed]
162
+ Clean accuracy: 0.0221
163
+ Mixed accuracy: 0.0160
164
+ Performance gap: 0.0061
165
+
166
+ [Geometric Stability]
167
+ Noise stable: True
168
+ CutMix stable: True
169
+ ```