AbstractPhil commited on
Commit
f1bb4db
Β·
verified Β·
1 Parent(s): 136fb0b

Epoch 50: 56.68%

Browse files
Files changed (1) hide show
  1. README.md +32 -36
README.md CHANGED
@@ -5,7 +5,7 @@ tags:
5
  - cifar100
6
  - geometric-learning
7
  - fractal-encoding
8
- - trained
9
  - no-attention
10
  - no-cross-entropy
11
  datasets:
@@ -15,7 +15,7 @@ metrics:
15
  library_name: pytorch
16
  pipeline_tag: image-classification
17
  model-index:
18
- - name: geo-beatrix
19
  results:
20
  - task:
21
  type: image-classification
@@ -30,13 +30,13 @@ model-index:
30
  verified: false
31
  ---
32
 
33
- # geo-beatrix
34
 
35
  **Geometric Basin Classification for CIFAR-100**
36
 
37
- πŸŽ‰ **Training Complete** πŸŽ‰
38
 
39
- Final Status: Epoch 200/200
40
 
41
  ---
42
 
@@ -46,23 +46,23 @@ Final Status: Epoch 200/200
46
  |--------|-------|
47
  | **Best Test Accuracy** | **67.43%** |
48
  | **Best Epoch** | 195 |
49
- | **Current Train Accuracy** | 62.96% |
50
- | **Current Test Accuracy** | 67.13% |
51
- | **Current Ξ± (Cantor param)** | 0.4424 |
52
- | **Total Parameters** | 45,235,067 |
53
- | **Training Time** | 0:56:23 |
54
 
55
  ### All Training Runs
56
 
57
  | Timestamp | Status | Best Epoch | Test Acc | Train Acc | Ξ± |
58
  |-----------|--------|------------|----------|-----------|---|
59
- | `20251010_014649` | βœ… | 195 | **67.43%** | 62.96% | 0.4424 |
60
 
61
  ### Comparison to State-of-the-Art
62
 
63
  | Model | Accuracy | Status |
64
  |-------|----------|--------|
65
- | **geo-beatrix (this model)** | **67.43%** | βœ… Complete |
66
  | vit-beatrix-dualstream | 66.0% | Vision Transformer + Cross-Entropy |
67
  | CLIP ViT-L/14 (zero-shot) | ~63-65% | 400M image-text pairs |
68
  | CLIP ViT-B/32 (zero-shot) | ~63.5% | Vision Transformer |
@@ -77,7 +77,7 @@ Final Status: Epoch 200/200
77
  - **Channels**: 64 β†’ 128 β†’ 256 β†’ 512 β†’ 1024
78
  - **Positional Encoding**: Devil's Staircase (Cantor function, 1883)
79
  - **PE Levels**: 20
80
- - **PE Features/Level**: 10
81
  - **Classification**: Geometric Basin Compatibility (NO cross-entropy)
82
  - **Attention Mechanisms**: NONE
83
 
@@ -87,7 +87,7 @@ Final Status: Epoch 200/200
87
 
88
  ```json
89
  {
90
- "model_name": "geo-beatrix",
91
  "model_type": "geometric_basin_classifier",
92
  "num_classes": 100,
93
  "batch_size": 256,
@@ -96,7 +96,7 @@ Final Status: Epoch 200/200
96
  "weight_decay": 0.05,
97
  "warmup_epochs": 10,
98
  "pe_levels": 20,
99
- "pe_features_per_level": 10,
100
  "dropout": 0.1,
101
  "upload_every_n_epochs": 50,
102
  "alphamix": {
@@ -106,14 +106,14 @@ Final Status: Epoch 200/200
106
  0.7
107
  ],
108
  "spatial_ratio": 0.25,
109
- "curriculum_start": 0.0,
110
- "curriculum_end": 0.5
111
  },
112
  "architecture": "ResNet-style with Devil's Staircase PE",
113
  "loss_function": "Geometric Basin Compatibility",
114
  "cross_entropy": false,
115
  "attention_mechanisms": false,
116
- "timestamp": "20251010_014649"
117
  }
118
  ```
119
 
@@ -127,7 +127,7 @@ Final Status: Epoch 200/200
127
  β”œβ”€β”€ best_model_info.json (which epoch/run this came from)
128
  β”œβ”€β”€ runs_history.json (all training runs and their results)
129
  β”œβ”€β”€ README.md
130
- β”œβ”€β”€ weights/geo-beatrix/20251010_014649/
131
  β”‚ β”œβ”€β”€ model.pt (best from this training run)
132
  β”‚ β”œβ”€β”€ model.safetensors (best from this training run)
133
  β”‚ β”œβ”€β”€ config.json
@@ -137,7 +137,7 @@ Final Status: Epoch 200/200
137
  β”‚ β”œβ”€β”€ checkpoint_epoch_20.safetensors
138
  β”‚ └── checkpoint_epoch_30.safetensors
139
  β”‚ (snapshots every 50 epochs)
140
- └── runs/geo-beatrix/20251010_014649/
141
  β”œβ”€β”€ events.out.tfevents.* (TensorBoard logs)
142
  └── metrics.csv (training metrics)
143
  ```
@@ -173,13 +173,13 @@ with open(info_path) as f:
173
  # Or download from specific training run
174
  model_path = hf_hub_download(
175
  repo_id="AbstractPhil/geo-beatrix",
176
- filename="weights/geo-beatrix/20251010_014649/model.safetensors"
177
  )
178
 
179
  # Download specific epoch checkpoint
180
  epoch_checkpoint = hf_hub_download(
181
  repo_id="AbstractPhil/geo-beatrix",
182
- filename="weights/geo-beatrix/20251010_014649/checkpoints/checkpoint_epoch_100.safetensors"
183
  )
184
  ```
185
 
@@ -189,26 +189,22 @@ epoch_checkpoint = hf_hub_download(
189
 
190
  ### Best Checkpoint
191
  - Epoch: 195
192
- - Train Acc: 58.21%
193
  - Test Acc: 67.43%
194
- - Alpha: 0.4424
195
- - Loss: 0.4848
196
 
197
  ### Latest 5 Epochs
198
 
199
- - **Epoch 196**: Train 59.96%, Test 0.00%, Ξ±=0.4424, Loss=0.4921
200
- - **Epoch 197**: Train 60.25%, Test 0.00%, Ξ±=0.4424, Loss=0.4843
201
- - **Epoch 198**: Train 61.70%, Test 0.00%, Ξ±=0.4424, Loss=0.4852
202
- - **Epoch 199**: Train 63.14%, Test 0.00%, Ξ±=0.4424, Loss=0.4957
203
- - **Epoch 200**: Train 62.96%, Test 67.13%, Ξ±=0.4424, Loss=0.4965
204
 
205
  ### Training Milestones
206
- - 🎯 **50% Accuracy** reached at epoch 40
207
- - 🎯 **60% Accuracy** reached at epoch 60
208
- - πŸ† **Beat vit-beatrix (66.0%)** at epoch 145
209
- - πŸš€ **67% Accuracy** reached at epoch 175
210
- - πŸ“Š **Ξ± β‰₯ 0.40** reached at epoch 9
211
- - πŸ“Š **Ξ± β‰₯ 0.44** (near triadic equilibrium) at epoch 117
212
 
213
  ---
214
 
 
5
  - cifar100
6
  - geometric-learning
7
  - fractal-encoding
8
+ - in-training
9
  - no-attention
10
  - no-cross-entropy
11
  datasets:
 
15
  library_name: pytorch
16
  pipeline_tag: image-classification
17
  model-index:
18
+ - name: geo-beatrix-step20-feats100
19
  results:
20
  - task:
21
  type: image-classification
 
30
  verified: false
31
  ---
32
 
33
+ # geo-beatrix-step20-feats100
34
 
35
  **Geometric Basin Classification for CIFAR-100**
36
 
37
+ 🚧 **Training in Progress** 🚧
38
 
39
+ Current Status: Epoch 50/200
40
 
41
  ---
42
 
 
46
  |--------|-------|
47
  | **Best Test Accuracy** | **67.43%** |
48
  | **Best Epoch** | 195 |
49
+ | **Current Train Accuracy** | 61.27% |
50
+ | **Current Test Accuracy** | 56.68% |
51
+ | **Current Ξ± (Cantor param)** | 0.4217 |
52
+ | **Total Parameters** | 46,338,737 |
53
+ | **Training Time** | 0:13:18 |
54
 
55
  ### All Training Runs
56
 
57
  | Timestamp | Status | Best Epoch | Test Acc | Train Acc | Ξ± |
58
  |-----------|--------|------------|----------|-----------|---|
59
+ | `20251010_025042` | πŸ”„ | 195 | **67.43%** | 61.27% | 0.4217 |
60
 
61
  ### Comparison to State-of-the-Art
62
 
63
  | Model | Accuracy | Status |
64
  |-------|----------|--------|
65
+ | **geo-beatrix (this model)** | **67.43%** | πŸ”„ Training |
66
  | vit-beatrix-dualstream | 66.0% | Vision Transformer + Cross-Entropy |
67
  | CLIP ViT-L/14 (zero-shot) | ~63-65% | 400M image-text pairs |
68
  | CLIP ViT-B/32 (zero-shot) | ~63.5% | Vision Transformer |
 
77
  - **Channels**: 64 β†’ 128 β†’ 256 β†’ 512 β†’ 1024
78
  - **Positional Encoding**: Devil's Staircase (Cantor function, 1883)
79
  - **PE Levels**: 20
80
+ - **PE Features/Level**: 100
81
  - **Classification**: Geometric Basin Compatibility (NO cross-entropy)
82
  - **Attention Mechanisms**: NONE
83
 
 
87
 
88
  ```json
89
  {
90
+ "model_name": "geo-beatrix-step20-feats100",
91
  "model_type": "geometric_basin_classifier",
92
  "num_classes": 100,
93
  "batch_size": 256,
 
96
  "weight_decay": 0.05,
97
  "warmup_epochs": 10,
98
  "pe_levels": 20,
99
+ "pe_features_per_level": 100,
100
  "dropout": 0.1,
101
  "upload_every_n_epochs": 50,
102
  "alphamix": {
 
106
  0.7
107
  ],
108
  "spatial_ratio": 0.25,
109
+ "curriculum_start": 0.05,
110
+ "curriculum_end": 0.4
111
  },
112
  "architecture": "ResNet-style with Devil's Staircase PE",
113
  "loss_function": "Geometric Basin Compatibility",
114
  "cross_entropy": false,
115
  "attention_mechanisms": false,
116
+ "timestamp": "20251010_025042"
117
  }
118
  ```
119
 
 
127
  β”œβ”€β”€ best_model_info.json (which epoch/run this came from)
128
  β”œβ”€β”€ runs_history.json (all training runs and their results)
129
  β”œβ”€β”€ README.md
130
+ β”œβ”€β”€ weights/geo-beatrix-step20-feats100/20251010_025042/
131
  β”‚ β”œβ”€β”€ model.pt (best from this training run)
132
  β”‚ β”œβ”€β”€ model.safetensors (best from this training run)
133
  β”‚ β”œβ”€β”€ config.json
 
137
  β”‚ β”œβ”€β”€ checkpoint_epoch_20.safetensors
138
  β”‚ └── checkpoint_epoch_30.safetensors
139
  β”‚ (snapshots every 50 epochs)
140
+ └── runs/geo-beatrix-step20-feats100/20251010_025042/
141
  β”œβ”€β”€ events.out.tfevents.* (TensorBoard logs)
142
  └── metrics.csv (training metrics)
143
  ```
 
173
  # Or download from specific training run
174
  model_path = hf_hub_download(
175
  repo_id="AbstractPhil/geo-beatrix",
176
+ filename="weights/geo-beatrix-step20-feats100/20251010_025042/model.safetensors"
177
  )
178
 
179
  # Download specific epoch checkpoint
180
  epoch_checkpoint = hf_hub_download(
181
  repo_id="AbstractPhil/geo-beatrix",
182
+ filename="weights/geo-beatrix-step20-feats100/20251010_025042/checkpoints/checkpoint_epoch_100.safetensors"
183
  )
184
  ```
185
 
 
189
 
190
  ### Best Checkpoint
191
  - Epoch: 195
192
+ - Train Acc: 61.27%
193
  - Test Acc: 67.43%
194
+ - Alpha: 0.4217
195
+ - Loss: 0.0000
196
 
197
  ### Latest 5 Epochs
198
 
199
+ - **Epoch 46**: Train 59.31%, Test 0.00%, Ξ±=0.4166, Loss=1.1643
200
+ - **Epoch 47**: Train 59.62%, Test 0.00%, Ξ±=0.4222, Loss=1.1372
201
+ - **Epoch 48**: Train 60.62%, Test 0.00%, Ξ±=0.4214, Loss=1.1206
202
+ - **Epoch 49**: Train 60.84%, Test 0.00%, Ξ±=0.4228, Loss=1.1334
203
+ - **Epoch 50**: Train 61.27%, Test 56.68%, Ξ±=0.4217, Loss=1.1205
204
 
205
  ### Training Milestones
206
+ - 🎯 **50% Accuracy** reached at epoch 35
207
+ - πŸ“Š **Ξ± β‰₯ 0.40** reached at epoch 10
 
 
 
 
208
 
209
  ---
210