AbstractPhil commited on
Commit
d6e7bc0
Β·
verified Β·
1 Parent(s): 9491dac

Epoch 10: 25.03%

Browse files
Files changed (1) hide show
  1. README.md +56 -41
README.md CHANGED
@@ -25,7 +25,7 @@ model-index:
25
  type: cifar100
26
  metrics:
27
  - type: accuracy
28
- value: 46.26
29
  name: Test Accuracy
30
  verified: false
31
  ---
@@ -36,7 +36,7 @@ model-index:
36
 
37
  🚧 **Training in Progress** 🚧
38
 
39
- Current Status: Epoch 30/200
40
 
41
  ---
42
 
@@ -44,24 +44,24 @@ Current Status: Epoch 30/200
44
 
45
  | Metric | Value |
46
  |--------|-------|
47
- | **Best Test Accuracy** | **46.26%** |
48
- | **Best Epoch** | 30 |
49
- | **Current Train Accuracy** | 46.33% |
50
- | **Current Test Accuracy** | 46.26% |
51
- | **Current Ξ± (Cantor param)** | 0.4042 |
52
  | **Total Parameters** | 45,161,489 |
53
- | **Training Time** | 0:09:24 |
54
 
55
  ### Comparison to State-of-the-Art
56
 
57
  | Model | Accuracy | Status |
58
  |-------|----------|--------|
59
- | **geo-beatrix (this model)** | **46.26%** | πŸ”„ Training |
60
  | vit-beatrix-dualstream | 66.0% | Vision Transformer + Cross-Entropy |
61
  | CLIP ViT-L/14 (zero-shot) | ~63-65% | 400M image-text pairs |
62
  | CLIP ViT-B/32 (zero-shot) | ~63.5% | Vision Transformer |
63
 
64
- 🎯 **Current target**: Beat vit-beatrix (66.0%) - Currently -19.74%
65
 
66
  ---
67
 
@@ -106,42 +106,29 @@ Current Status: Epoch 30/200
106
  "loss_function": "Geometric Basin Compatibility",
107
  "cross_entropy": false,
108
  "attention_mechanisms": false,
109
- "timestamp": "20251009_215951"
110
  }
111
  ```
112
 
113
  ---
114
 
115
- ## Training History
116
-
117
- ### Training Progress
118
 
119
  ```
120
- Epochs: 30/200 (β–ˆβ–ˆβ–ˆ ) 15.0%
121
- Best Acc: 46.26%
122
- Current Ξ±: 0.4042 β†’ Target: 0.50 (triadic equilibrium)
123
- Status: πŸ”„ Training In Progress
 
 
 
 
 
 
 
 
124
  ```
125
 
126
- ### Best Checkpoint
127
- - Epoch: 30
128
- - Train Acc: 46.33%
129
- - Test Acc: 46.26%
130
- - Alpha: 0.4042
131
- - Loss: 1.6819
132
-
133
- ### Latest 5 Epochs
134
-
135
- - **Epoch 26**: Train 43.67%, Test 0.00%, Ξ±=0.4018, Loss=1.7948
136
- - **Epoch 27**: Train 44.03%, Test 0.00%, Ξ±=0.4000, Loss=1.7660
137
- - **Epoch 28**: Train 44.65%, Test 0.00%, Ξ±=0.4013, Loss=1.7252
138
- - **Epoch 29**: Train 45.45%, Test 0.00%, Ξ±=0.4041, Loss=1.7425
139
- - **Epoch 30**: Train 46.33%, Test 46.26%, Ξ±=0.4042, Loss=1.6819
140
-
141
- ### Training Milestones
142
- - πŸ“Š **Ξ± β‰₯ 0.40** reached at epoch 10
143
-
144
-
145
  ---
146
 
147
  ## Usage
@@ -150,11 +137,11 @@ Status: πŸ”„ Training In Progress
150
  from huggingface_hub import hf_hub_download
151
  import torch
152
 
153
- # Download best model (safetensors format - recommended)
154
  from safetensors.torch import load_file
155
  model_path = hf_hub_download(
156
  repo_id="AbstractPhil/geo-beatrix",
157
- filename="model.safetensors"
158
  )
159
  state_dict = load_file(model_path)
160
  # model.load_state_dict(state_dict)
@@ -162,7 +149,7 @@ state_dict = load_file(model_path)
162
  # Or download PyTorch checkpoint (includes optimizer state)
163
  checkpoint_path = hf_hub_download(
164
  repo_id="AbstractPhil/geo-beatrix",
165
- filename="model.pt"
166
  )
167
  checkpoint = torch.load(checkpoint_path)
168
  # model.load_state_dict(checkpoint['model_state_dict'])
@@ -170,12 +157,40 @@ checkpoint = torch.load(checkpoint_path)
170
  # Download specific epoch checkpoint
171
  epoch_checkpoint = hf_hub_download(
172
  repo_id="AbstractPhil/geo-beatrix",
173
- filename="checkpoints/checkpoint_epoch_100.safetensors"
 
 
 
 
 
 
174
  )
175
  ```
176
 
177
  ---
178
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
179
  ## Innovation
180
 
181
  βœ… **NO attention mechanisms**
 
25
  type: cifar100
26
  metrics:
27
  - type: accuracy
28
+ value: 25.03
29
  name: Test Accuracy
30
  verified: false
31
  ---
 
36
 
37
  🚧 **Training in Progress** 🚧
38
 
39
+ Current Status: Epoch 10/200
40
 
41
  ---
42
 
 
44
 
45
  | Metric | Value |
46
  |--------|-------|
47
+ | **Best Test Accuracy** | **25.03%** |
48
+ | **Best Epoch** | 10 |
49
+ | **Current Train Accuracy** | 24.79% |
50
+ | **Current Test Accuracy** | 25.03% |
51
+ | **Current Ξ± (Cantor param)** | 0.4097 |
52
  | **Total Parameters** | 45,161,489 |
53
+ | **Training Time** | 0:02:43 |
54
 
55
  ### Comparison to State-of-the-Art
56
 
57
  | Model | Accuracy | Status |
58
  |-------|----------|--------|
59
+ | **geo-beatrix (this model)** | **25.03%** | πŸ”„ Training |
60
  | vit-beatrix-dualstream | 66.0% | Vision Transformer + Cross-Entropy |
61
  | CLIP ViT-L/14 (zero-shot) | ~63-65% | 400M image-text pairs |
62
  | CLIP ViT-B/32 (zero-shot) | ~63.5% | Vision Transformer |
63
 
64
+ 🎯 **Current target**: Beat vit-beatrix (66.0%) - Currently -40.97%
65
 
66
  ---
67
 
 
106
  "loss_function": "Geometric Basin Compatibility",
107
  "cross_entropy": false,
108
  "attention_mechanisms": false,
109
+ "timestamp": "20251009_221125"
110
  }
111
  ```
112
 
113
  ---
114
 
115
+ ## Files Structure
 
 
116
 
117
  ```
118
+ weights/geo-beatrix/20251009_221125/
119
+ β”œβ”€β”€ model.pt (best checkpoint - PyTorch)
120
+ β”œβ”€β”€ model.safetensors (best checkpoint - SafeTensors)
121
+ β”œβ”€β”€ config.json (model configuration)
122
+ β”œβ”€β”€ training_log.txt (training log)
123
+ └── checkpoints/
124
+ β”œβ”€β”€ checkpoint_epoch_*.pt
125
+ └── checkpoint_epoch_*.safetensors
126
+
127
+ runs/geo-beatrix/20251009_221125/
128
+ β”œβ”€β”€ events.out.tfevents.* (TensorBoard logs)
129
+ └── metrics.csv (training metrics)
130
  ```
131
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
132
  ---
133
 
134
  ## Usage
 
137
  from huggingface_hub import hf_hub_download
138
  import torch
139
 
140
+ # Download best model (SafeTensors - recommended)
141
  from safetensors.torch import load_file
142
  model_path = hf_hub_download(
143
  repo_id="AbstractPhil/geo-beatrix",
144
+ filename="weights/geo-beatrix/20251009_221125/model.safetensors"
145
  )
146
  state_dict = load_file(model_path)
147
  # model.load_state_dict(state_dict)
 
149
  # Or download PyTorch checkpoint (includes optimizer state)
150
  checkpoint_path = hf_hub_download(
151
  repo_id="AbstractPhil/geo-beatrix",
152
+ filename="weights/geo-beatrix/20251009_221125/model.pt"
153
  )
154
  checkpoint = torch.load(checkpoint_path)
155
  # model.load_state_dict(checkpoint['model_state_dict'])
 
157
  # Download specific epoch checkpoint
158
  epoch_checkpoint = hf_hub_download(
159
  repo_id="AbstractPhil/geo-beatrix",
160
+ filename="weights/geo-beatrix/20251009_221125/checkpoints/checkpoint_epoch_100.safetensors"
161
+ )
162
+
163
+ # Download TensorBoard logs
164
+ tensorboard_log = hf_hub_download(
165
+ repo_id="AbstractPhil/geo-beatrix",
166
+ filename="runs/geo-beatrix/20251009_221125/events.out.tfevents.*"
167
  )
168
  ```
169
 
170
  ---
171
 
172
+ ## Training History
173
+
174
+ ### Best Checkpoint
175
+ - Epoch: 10
176
+ - Train Acc: 24.79%
177
+ - Test Acc: 25.03%
178
+ - Alpha: 0.4097
179
+ - Loss: 2.2922
180
+
181
+ ### Latest 5 Epochs
182
+
183
+ - **Epoch 6**: Train 11.86%, Test 0.00%, Ξ±=0.3382, Loss=2.7329
184
+ - **Epoch 7**: Train 14.90%, Test 0.00%, Ξ±=0.3664, Loss=2.5766
185
+ - **Epoch 8**: Train 18.45%, Test 0.00%, Ξ±=0.3868, Loss=2.4434
186
+ - **Epoch 9**: Train 22.42%, Test 0.00%, Ξ±=0.4014, Loss=2.4042
187
+ - **Epoch 10**: Train 24.79%, Test 25.03%, Ξ±=0.4097, Loss=2.2922
188
+
189
+ ### Training Milestones
190
+ - πŸ“Š **Ξ± β‰₯ 0.40** reached at epoch 9
191
+
192
+ ---
193
+
194
  ## Innovation
195
 
196
  βœ… **NO attention mechanisms**