AbstractPhil commited on
Commit
70108cc
Β·
verified Β·
1 Parent(s): 4e2c44b

Epoch 50: 31.90%

Browse files
Files changed (1) hide show
  1. README.md +32 -33
README.md CHANGED
@@ -5,7 +5,7 @@ tags:
5
  - cifar100
6
  - geometric-learning
7
  - fractal-encoding
8
- - trained
9
  - no-attention
10
  - no-cross-entropy
11
  datasets:
@@ -15,7 +15,7 @@ metrics:
15
  library_name: pytorch
16
  pipeline_tag: image-classification
17
  model-index:
18
- - name: geo-beatrix-resnet34-step12-feats100
19
  results:
20
  - task:
21
  type: image-classification
@@ -30,13 +30,13 @@ model-index:
30
  verified: false
31
  ---
32
 
33
- # geo-beatrix-resnet34-step12-feats100
34
 
35
  **Geometric Basin Classification for CIFAR-100**
36
 
37
- πŸŽ‰ **Training Complete** πŸŽ‰
38
 
39
- Final Status: Epoch 200/200
40
 
41
  ---
42
 
@@ -46,11 +46,11 @@ Final Status: Epoch 200/200
46
  |--------|-------|
47
  | **Best Test Accuracy** | **56.12%** |
48
  | **Best Epoch** | 160 |
49
- | **Current Train Accuracy** | 57.80% |
50
- | **Current Test Accuracy** | 42.63% |
51
- | **Current Ξ± (Cantor param)** | 0.4994 |
52
- | **Total Parameters** | 21,846,001 |
53
- | **Training Time** | 0:20:47 |
54
 
55
  ### All Training Runs
56
 
@@ -65,6 +65,7 @@ Final Status: Epoch 200/200
65
  | `20251011_012453` | βœ… | 160 | **56.12%** | 40.18% | 0.4963 |
66
  | `20251011_023128` | βœ… | 160 | **56.12%** | 54.65% | 0.5005 |
67
  | `20251011_025919` | βœ… | 160 | **56.12%** | 57.80% | 0.4994 |
 
68
  | `20251010_200842` | βœ… | 180 | **53.61%** | 67.53% | 0.4442 |
69
  | `20251010_185133` | βœ… | 200 | **52.97%** | 69.87% | 0.4452 |
70
 
@@ -72,7 +73,7 @@ Final Status: Epoch 200/200
72
 
73
  | Model | Accuracy | Status |
74
  |-------|----------|--------|
75
- | **geo-beatrix (this model)** | **56.12%** | βœ… Complete |
76
  | geo-beatrix (50M params) | 69.0% | Geometric Basin CONV architecture |
77
 
78
  🎯 **Current target**: Beat geo-beatrix (69.0%) - Currently -12.88%
@@ -85,8 +86,8 @@ Final Status: Epoch 200/200
85
  - **Pretrained**: From scratch
86
  - **Features**: 512-dim from ResNet34
87
  - **Positional Encoding**: Devil's Staircase (Cantor function, 1883)
88
- - **PE Levels**: 12
89
- - **PE Features/Level**: 100
90
  - **Classification**: Geometric Basin Compatibility (NO cross-entropy)
91
  - **Attention Mechanisms**: NONE
92
  - **Mixing**: Fractal (triadic multi-patch)
@@ -97,7 +98,7 @@ Final Status: Epoch 200/200
97
 
98
  ```json
99
  {
100
- "model_name": "geo-beatrix-resnet34-step12-feats100",
101
  "model_type": "geometric_basin_classifier",
102
  "num_classes": 100,
103
  "batch_size": 512,
@@ -105,8 +106,8 @@ Final Status: Epoch 200/200
105
  "base_learning_rate": 0.001,
106
  "weight_decay": 0.05,
107
  "warmup_epochs": 10,
108
- "pe_levels": 12,
109
- "pe_features_per_level": 100,
110
  "dropout": 0.1,
111
  "pretrained_resnet": false,
112
  "frozen_resnet": false,
@@ -140,7 +141,7 @@ Final Status: Epoch 200/200
140
  "loss_function": "Geometric Basin Compatibility",
141
  "cross_entropy": false,
142
  "attention_mechanisms": false,
143
- "timestamp": "20251011_025919"
144
  }
145
  ```
146
 
@@ -154,7 +155,7 @@ Final Status: Epoch 200/200
154
  β”œβ”€β”€ best_model_info.json (which epoch/run this came from)
155
  β”œβ”€β”€ runs_history.json (all training runs and their results)
156
  β”œβ”€β”€ README.md
157
- β”œβ”€β”€ weights/geo-beatrix-resnet34-step12-feats100/20251011_025919/
158
  β”‚ β”œβ”€β”€ model.pt (best from this training run)
159
  β”‚ β”œβ”€β”€ model.safetensors (best from this training run)
160
  β”‚ β”œβ”€β”€ config.json
@@ -164,7 +165,7 @@ Final Status: Epoch 200/200
164
  β”‚ β”œβ”€β”€ checkpoint_epoch_100.safetensors
165
  β”‚ └── checkpoint_epoch_150.safetensors
166
  β”‚ (snapshots every 10 epochs)
167
- └── runs/geo-beatrix-resnet34-step12-feats100/20251011_025919/
168
  β”œβ”€β”€ events.out.tfevents.* (TensorBoard logs)
169
  └── metrics.csv (training metrics)
170
  ```
@@ -200,13 +201,13 @@ with open(info_path) as f:
200
  # Or download from specific training run
201
  model_path = hf_hub_download(
202
  repo_id="AbstractPhil/geo-beatrix-resnet",
203
- filename="weights/geo-beatrix-resnet34-step12-feats100/20251011_025919/model.safetensors"
204
  )
205
 
206
  # Download specific epoch checkpoint
207
  epoch_checkpoint = hf_hub_download(
208
  repo_id="AbstractPhil/geo-beatrix-resnet",
209
- filename="weights/geo-beatrix-resnet34-step12-feats100/20251011_025919/checkpoints/checkpoint_epoch_100.safetensors"
210
  )
211
  ```
212
 
@@ -216,23 +217,21 @@ epoch_checkpoint = hf_hub_download(
216
 
217
  ### Best Checkpoint
218
  - Epoch: 160
219
- - Train Acc: 54.78%
220
- - Test Acc: 40.25%
221
- - Alpha: 0.5023
222
- - Loss: 0.8972
223
 
224
  ### Latest 5 Epochs
225
 
226
- - **Epoch 196**: Train 59.74%, Test 0.00%, Ξ±=0.4994, Loss=0.9041
227
- - **Epoch 197**: Train 57.60%, Test 0.00%, Ξ±=0.4991, Loss=0.8370
228
- - **Epoch 198**: Train 57.25%, Test 0.00%, Ξ±=0.4993, Loss=0.8311
229
- - **Epoch 199**: Train 60.42%, Test 0.00%, Ξ±=0.4995, Loss=0.9093
230
- - **Epoch 200**: Train 57.80%, Test 42.63%, Ξ±=0.4994, Loss=0.8336
231
 
232
  ### Training Milestones
233
- - πŸ“Š **Ξ± β‰₯ 0.40** reached at epoch 1
234
- - πŸ“Š **Ξ± β‰₯ 0.44** (near triadic equilibrium) at epoch 1
235
- - βš›οΈ **Ξ± = 0.50** (TRIADIC EQUILIBRIUM!) at epoch 2
236
 
237
  ---
238
 
 
5
  - cifar100
6
  - geometric-learning
7
  - fractal-encoding
8
+ - in-training
9
  - no-attention
10
  - no-cross-entropy
11
  datasets:
 
15
  library_name: pytorch
16
  pipeline_tag: image-classification
17
  model-index:
18
+ - name: geo-beatrix-resnet34-step20-feats1000
19
  results:
20
  - task:
21
  type: image-classification
 
30
  verified: false
31
  ---
32
 
33
+ # geo-beatrix-resnet34-step20-feats1000
34
 
35
  **Geometric Basin Classification for CIFAR-100**
36
 
37
+ 🚧 **Training in Progress** 🚧
38
 
39
+ Current Status: Epoch 50/200
40
 
41
  ---
42
 
 
46
  |--------|-------|
47
  | **Best Test Accuracy** | **56.12%** |
48
  | **Best Epoch** | 160 |
49
+ | **Current Train Accuracy** | 39.59% |
50
+ | **Current Test Accuracy** | 31.90% |
51
+ | **Current Ξ± (Cantor param)** | 0.4103 |
52
+ | **Total Parameters** | 28,561,101 |
53
+ | **Training Time** | 0:05:11 |
54
 
55
  ### All Training Runs
56
 
 
65
  | `20251011_012453` | βœ… | 160 | **56.12%** | 40.18% | 0.4963 |
66
  | `20251011_023128` | βœ… | 160 | **56.12%** | 54.65% | 0.5005 |
67
  | `20251011_025919` | βœ… | 160 | **56.12%** | 57.80% | 0.4994 |
68
+ | `20251011_032343` | πŸ”„ | 160 | **56.12%** | 39.59% | 0.4103 |
69
  | `20251010_200842` | βœ… | 180 | **53.61%** | 67.53% | 0.4442 |
70
  | `20251010_185133` | βœ… | 200 | **52.97%** | 69.87% | 0.4452 |
71
 
 
73
 
74
  | Model | Accuracy | Status |
75
  |-------|----------|--------|
76
+ | **geo-beatrix (this model)** | **56.12%** | πŸ”„ Training |
77
  | geo-beatrix (50M params) | 69.0% | Geometric Basin CONV architecture |
78
 
79
  🎯 **Current target**: Beat geo-beatrix (69.0%) - Currently -12.88%
 
86
  - **Pretrained**: From scratch
87
  - **Features**: 512-dim from ResNet34
88
  - **Positional Encoding**: Devil's Staircase (Cantor function, 1883)
89
+ - **PE Levels**: 20
90
+ - **PE Features/Level**: 1000
91
  - **Classification**: Geometric Basin Compatibility (NO cross-entropy)
92
  - **Attention Mechanisms**: NONE
93
  - **Mixing**: Fractal (triadic multi-patch)
 
98
 
99
  ```json
100
  {
101
+ "model_name": "geo-beatrix-resnet34-step20-feats1000",
102
  "model_type": "geometric_basin_classifier",
103
  "num_classes": 100,
104
  "batch_size": 512,
 
106
  "base_learning_rate": 0.001,
107
  "weight_decay": 0.05,
108
  "warmup_epochs": 10,
109
+ "pe_levels": 20,
110
+ "pe_features_per_level": 1000,
111
  "dropout": 0.1,
112
  "pretrained_resnet": false,
113
  "frozen_resnet": false,
 
141
  "loss_function": "Geometric Basin Compatibility",
142
  "cross_entropy": false,
143
  "attention_mechanisms": false,
144
+ "timestamp": "20251011_032343"
145
  }
146
  ```
147
 
 
155
  β”œβ”€β”€ best_model_info.json (which epoch/run this came from)
156
  β”œβ”€β”€ runs_history.json (all training runs and their results)
157
  β”œβ”€β”€ README.md
158
+ β”œβ”€β”€ weights/geo-beatrix-resnet34-step20-feats1000/20251011_032343/
159
  β”‚ β”œβ”€β”€ model.pt (best from this training run)
160
  β”‚ β”œβ”€β”€ model.safetensors (best from this training run)
161
  β”‚ β”œβ”€β”€ config.json
 
165
  β”‚ β”œβ”€β”€ checkpoint_epoch_100.safetensors
166
  β”‚ └── checkpoint_epoch_150.safetensors
167
  β”‚ (snapshots every 10 epochs)
168
+ └── runs/geo-beatrix-resnet34-step20-feats1000/20251011_032343/
169
  β”œβ”€β”€ events.out.tfevents.* (TensorBoard logs)
170
  └── metrics.csv (training metrics)
171
  ```
 
201
  # Or download from specific training run
202
  model_path = hf_hub_download(
203
  repo_id="AbstractPhil/geo-beatrix-resnet",
204
+ filename="weights/geo-beatrix-resnet34-step20-feats1000/20251011_032343/model.safetensors"
205
  )
206
 
207
  # Download specific epoch checkpoint
208
  epoch_checkpoint = hf_hub_download(
209
  repo_id="AbstractPhil/geo-beatrix-resnet",
210
+ filename="weights/geo-beatrix-resnet34-step20-feats1000/20251011_032343/checkpoints/checkpoint_epoch_100.safetensors"
211
  )
212
  ```
213
 
 
217
 
218
  ### Best Checkpoint
219
  - Epoch: 160
220
+ - Train Acc: 39.59%
221
+ - Test Acc: 56.12%
222
+ - Alpha: 0.4103
223
+ - Loss: 0.0000
224
 
225
  ### Latest 5 Epochs
226
 
227
+ - **Epoch 46**: Train 37.85%, Test 0.00%, Ξ±=0.4061, Loss=1.8099
228
+ - **Epoch 47**: Train 38.80%, Test 0.00%, Ξ±=0.4090, Loss=1.7620
229
+ - **Epoch 48**: Train 38.73%, Test 0.00%, Ξ±=0.4112, Loss=1.7839
230
+ - **Epoch 49**: Train 38.73%, Test 0.00%, Ξ±=0.4120, Loss=1.7659
231
+ - **Epoch 50**: Train 39.59%, Test 31.90%, Ξ±=0.4103, Loss=1.7749
232
 
233
  ### Training Milestones
234
+ - πŸ“Š **Ξ± β‰₯ 0.40** reached at epoch 40
 
 
235
 
236
  ---
237