Epoch 50: 31.90%
Browse files
README.md
CHANGED
|
@@ -5,7 +5,7 @@ tags:
|
|
| 5 |
- cifar100
|
| 6 |
- geometric-learning
|
| 7 |
- fractal-encoding
|
| 8 |
-
-
|
| 9 |
- no-attention
|
| 10 |
- no-cross-entropy
|
| 11 |
datasets:
|
|
@@ -15,7 +15,7 @@ metrics:
|
|
| 15 |
library_name: pytorch
|
| 16 |
pipeline_tag: image-classification
|
| 17 |
model-index:
|
| 18 |
-
- name: geo-beatrix-resnet34-
|
| 19 |
results:
|
| 20 |
- task:
|
| 21 |
type: image-classification
|
|
@@ -30,13 +30,13 @@ model-index:
|
|
| 30 |
verified: false
|
| 31 |
---
|
| 32 |
|
| 33 |
-
# geo-beatrix-resnet34-
|
| 34 |
|
| 35 |
**Geometric Basin Classification for CIFAR-100**
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
---
|
| 42 |
|
|
@@ -46,11 +46,11 @@ Final Status: Epoch 200/200
|
|
| 46 |
|--------|-------|
|
| 47 |
| **Best Test Accuracy** | **56.12%** |
|
| 48 |
| **Best Epoch** | 160 |
|
| 49 |
-
| **Current Train Accuracy** |
|
| 50 |
-
| **Current Test Accuracy** |
|
| 51 |
-
| **Current Ξ± (Cantor param)** | 0.
|
| 52 |
-
| **Total Parameters** |
|
| 53 |
-
| **Training Time** | 0:
|
| 54 |
|
| 55 |
### All Training Runs
|
| 56 |
|
|
@@ -65,6 +65,7 @@ Final Status: Epoch 200/200
|
|
| 65 |
| `20251011_012453` | β
| 160 | **56.12%** | 40.18% | 0.4963 |
|
| 66 |
| `20251011_023128` | β
| 160 | **56.12%** | 54.65% | 0.5005 |
|
| 67 |
| `20251011_025919` | β
| 160 | **56.12%** | 57.80% | 0.4994 |
|
|
|
|
| 68 |
| `20251010_200842` | β
| 180 | **53.61%** | 67.53% | 0.4442 |
|
| 69 |
| `20251010_185133` | β
| 200 | **52.97%** | 69.87% | 0.4452 |
|
| 70 |
|
|
@@ -72,7 +73,7 @@ Final Status: Epoch 200/200
|
|
| 72 |
|
| 73 |
| Model | Accuracy | Status |
|
| 74 |
|-------|----------|--------|
|
| 75 |
-
| **geo-beatrix (this model)** | **56.12%** |
|
| 76 |
| geo-beatrix (50M params) | 69.0% | Geometric Basin CONV architecture |
|
| 77 |
|
| 78 |
π― **Current target**: Beat geo-beatrix (69.0%) - Currently -12.88%
|
|
@@ -85,8 +86,8 @@ Final Status: Epoch 200/200
|
|
| 85 |
- **Pretrained**: From scratch
|
| 86 |
- **Features**: 512-dim from ResNet34
|
| 87 |
- **Positional Encoding**: Devil's Staircase (Cantor function, 1883)
|
| 88 |
-
- **PE Levels**:
|
| 89 |
-
- **PE Features/Level**:
|
| 90 |
- **Classification**: Geometric Basin Compatibility (NO cross-entropy)
|
| 91 |
- **Attention Mechanisms**: NONE
|
| 92 |
- **Mixing**: Fractal (triadic multi-patch)
|
|
@@ -97,7 +98,7 @@ Final Status: Epoch 200/200
|
|
| 97 |
|
| 98 |
```json
|
| 99 |
{
|
| 100 |
-
"model_name": "geo-beatrix-resnet34-
|
| 101 |
"model_type": "geometric_basin_classifier",
|
| 102 |
"num_classes": 100,
|
| 103 |
"batch_size": 512,
|
|
@@ -105,8 +106,8 @@ Final Status: Epoch 200/200
|
|
| 105 |
"base_learning_rate": 0.001,
|
| 106 |
"weight_decay": 0.05,
|
| 107 |
"warmup_epochs": 10,
|
| 108 |
-
"pe_levels":
|
| 109 |
-
"pe_features_per_level":
|
| 110 |
"dropout": 0.1,
|
| 111 |
"pretrained_resnet": false,
|
| 112 |
"frozen_resnet": false,
|
|
@@ -140,7 +141,7 @@ Final Status: Epoch 200/200
|
|
| 140 |
"loss_function": "Geometric Basin Compatibility",
|
| 141 |
"cross_entropy": false,
|
| 142 |
"attention_mechanisms": false,
|
| 143 |
-
"timestamp": "
|
| 144 |
}
|
| 145 |
```
|
| 146 |
|
|
@@ -154,7 +155,7 @@ Final Status: Epoch 200/200
|
|
| 154 |
βββ best_model_info.json (which epoch/run this came from)
|
| 155 |
βββ runs_history.json (all training runs and their results)
|
| 156 |
βββ README.md
|
| 157 |
-
βββ weights/geo-beatrix-resnet34-
|
| 158 |
β βββ model.pt (best from this training run)
|
| 159 |
β βββ model.safetensors (best from this training run)
|
| 160 |
β βββ config.json
|
|
@@ -164,7 +165,7 @@ Final Status: Epoch 200/200
|
|
| 164 |
β βββ checkpoint_epoch_100.safetensors
|
| 165 |
β βββ checkpoint_epoch_150.safetensors
|
| 166 |
β (snapshots every 10 epochs)
|
| 167 |
-
βββ runs/geo-beatrix-resnet34-
|
| 168 |
βββ events.out.tfevents.* (TensorBoard logs)
|
| 169 |
βββ metrics.csv (training metrics)
|
| 170 |
```
|
|
@@ -200,13 +201,13 @@ with open(info_path) as f:
|
|
| 200 |
# Or download from specific training run
|
| 201 |
model_path = hf_hub_download(
|
| 202 |
repo_id="AbstractPhil/geo-beatrix-resnet",
|
| 203 |
-
filename="weights/geo-beatrix-resnet34-
|
| 204 |
)
|
| 205 |
|
| 206 |
# Download specific epoch checkpoint
|
| 207 |
epoch_checkpoint = hf_hub_download(
|
| 208 |
repo_id="AbstractPhil/geo-beatrix-resnet",
|
| 209 |
-
filename="weights/geo-beatrix-resnet34-
|
| 210 |
)
|
| 211 |
```
|
| 212 |
|
|
@@ -216,23 +217,21 @@ epoch_checkpoint = hf_hub_download(
|
|
| 216 |
|
| 217 |
### Best Checkpoint
|
| 218 |
- Epoch: 160
|
| 219 |
-
- Train Acc:
|
| 220 |
-
- Test Acc:
|
| 221 |
-
- Alpha: 0.
|
| 222 |
-
- Loss: 0.
|
| 223 |
|
| 224 |
### Latest 5 Epochs
|
| 225 |
|
| 226 |
-
- **Epoch
|
| 227 |
-
- **Epoch
|
| 228 |
-
- **Epoch
|
| 229 |
-
- **Epoch
|
| 230 |
-
- **Epoch
|
| 231 |
|
| 232 |
### Training Milestones
|
| 233 |
-
- π **Ξ± β₯ 0.40** reached at epoch
|
| 234 |
-
- π **Ξ± β₯ 0.44** (near triadic equilibrium) at epoch 1
|
| 235 |
-
- βοΈ **Ξ± = 0.50** (TRIADIC EQUILIBRIUM!) at epoch 2
|
| 236 |
|
| 237 |
---
|
| 238 |
|
|
|
|
| 5 |
- cifar100
|
| 6 |
- geometric-learning
|
| 7 |
- fractal-encoding
|
| 8 |
+
- in-training
|
| 9 |
- no-attention
|
| 10 |
- no-cross-entropy
|
| 11 |
datasets:
|
|
|
|
| 15 |
library_name: pytorch
|
| 16 |
pipeline_tag: image-classification
|
| 17 |
model-index:
|
| 18 |
+
- name: geo-beatrix-resnet34-step20-feats1000
|
| 19 |
results:
|
| 20 |
- task:
|
| 21 |
type: image-classification
|
|
|
|
| 30 |
verified: false
|
| 31 |
---
|
| 32 |
|
| 33 |
+
# geo-beatrix-resnet34-step20-feats1000
|
| 34 |
|
| 35 |
**Geometric Basin Classification for CIFAR-100**
|
| 36 |
|
| 37 |
+
π§ **Training in Progress** π§
|
| 38 |
|
| 39 |
+
Current Status: Epoch 50/200
|
| 40 |
|
| 41 |
---
|
| 42 |
|
|
|
|
| 46 |
|--------|-------|
|
| 47 |
| **Best Test Accuracy** | **56.12%** |
|
| 48 |
| **Best Epoch** | 160 |
|
| 49 |
+
| **Current Train Accuracy** | 39.59% |
|
| 50 |
+
| **Current Test Accuracy** | 31.90% |
|
| 51 |
+
| **Current Ξ± (Cantor param)** | 0.4103 |
|
| 52 |
+
| **Total Parameters** | 28,561,101 |
|
| 53 |
+
| **Training Time** | 0:05:11 |
|
| 54 |
|
| 55 |
### All Training Runs
|
| 56 |
|
|
|
|
| 65 |
| `20251011_012453` | β
| 160 | **56.12%** | 40.18% | 0.4963 |
|
| 66 |
| `20251011_023128` | β
| 160 | **56.12%** | 54.65% | 0.5005 |
|
| 67 |
| `20251011_025919` | β
| 160 | **56.12%** | 57.80% | 0.4994 |
|
| 68 |
+
| `20251011_032343` | π | 160 | **56.12%** | 39.59% | 0.4103 |
|
| 69 |
| `20251010_200842` | β
| 180 | **53.61%** | 67.53% | 0.4442 |
|
| 70 |
| `20251010_185133` | β
| 200 | **52.97%** | 69.87% | 0.4452 |
|
| 71 |
|
|
|
|
| 73 |
|
| 74 |
| Model | Accuracy | Status |
|
| 75 |
|-------|----------|--------|
|
| 76 |
+
| **geo-beatrix (this model)** | **56.12%** | π Training |
|
| 77 |
| geo-beatrix (50M params) | 69.0% | Geometric Basin CONV architecture |
|
| 78 |
|
| 79 |
π― **Current target**: Beat geo-beatrix (69.0%) - Currently -12.88%
|
|
|
|
| 86 |
- **Pretrained**: From scratch
|
| 87 |
- **Features**: 512-dim from ResNet34
|
| 88 |
- **Positional Encoding**: Devil's Staircase (Cantor function, 1883)
|
| 89 |
+
- **PE Levels**: 20
|
| 90 |
+
- **PE Features/Level**: 1000
|
| 91 |
- **Classification**: Geometric Basin Compatibility (NO cross-entropy)
|
| 92 |
- **Attention Mechanisms**: NONE
|
| 93 |
- **Mixing**: Fractal (triadic multi-patch)
|
|
|
|
| 98 |
|
| 99 |
```json
|
| 100 |
{
|
| 101 |
+
"model_name": "geo-beatrix-resnet34-step20-feats1000",
|
| 102 |
"model_type": "geometric_basin_classifier",
|
| 103 |
"num_classes": 100,
|
| 104 |
"batch_size": 512,
|
|
|
|
| 106 |
"base_learning_rate": 0.001,
|
| 107 |
"weight_decay": 0.05,
|
| 108 |
"warmup_epochs": 10,
|
| 109 |
+
"pe_levels": 20,
|
| 110 |
+
"pe_features_per_level": 1000,
|
| 111 |
"dropout": 0.1,
|
| 112 |
"pretrained_resnet": false,
|
| 113 |
"frozen_resnet": false,
|
|
|
|
| 141 |
"loss_function": "Geometric Basin Compatibility",
|
| 142 |
"cross_entropy": false,
|
| 143 |
"attention_mechanisms": false,
|
| 144 |
+
"timestamp": "20251011_032343"
|
| 145 |
}
|
| 146 |
```
|
| 147 |
|
|
|
|
| 155 |
βββ best_model_info.json (which epoch/run this came from)
|
| 156 |
βββ runs_history.json (all training runs and their results)
|
| 157 |
βββ README.md
|
| 158 |
+
βββ weights/geo-beatrix-resnet34-step20-feats1000/20251011_032343/
|
| 159 |
β βββ model.pt (best from this training run)
|
| 160 |
β βββ model.safetensors (best from this training run)
|
| 161 |
β βββ config.json
|
|
|
|
| 165 |
β βββ checkpoint_epoch_100.safetensors
|
| 166 |
β βββ checkpoint_epoch_150.safetensors
|
| 167 |
β (snapshots every 10 epochs)
|
| 168 |
+
βββ runs/geo-beatrix-resnet34-step20-feats1000/20251011_032343/
|
| 169 |
βββ events.out.tfevents.* (TensorBoard logs)
|
| 170 |
βββ metrics.csv (training metrics)
|
| 171 |
```
|
|
|
|
| 201 |
# Or download from specific training run
|
| 202 |
model_path = hf_hub_download(
|
| 203 |
repo_id="AbstractPhil/geo-beatrix-resnet",
|
| 204 |
+
filename="weights/geo-beatrix-resnet34-step20-feats1000/20251011_032343/model.safetensors"
|
| 205 |
)
|
| 206 |
|
| 207 |
# Download specific epoch checkpoint
|
| 208 |
epoch_checkpoint = hf_hub_download(
|
| 209 |
repo_id="AbstractPhil/geo-beatrix-resnet",
|
| 210 |
+
filename="weights/geo-beatrix-resnet34-step20-feats1000/20251011_032343/checkpoints/checkpoint_epoch_100.safetensors"
|
| 211 |
)
|
| 212 |
```
|
| 213 |
|
|
|
|
| 217 |
|
| 218 |
### Best Checkpoint
|
| 219 |
- Epoch: 160
|
| 220 |
+
- Train Acc: 39.59%
|
| 221 |
+
- Test Acc: 56.12%
|
| 222 |
+
- Alpha: 0.4103
|
| 223 |
+
- Loss: 0.0000
|
| 224 |
|
| 225 |
### Latest 5 Epochs
|
| 226 |
|
| 227 |
+
- **Epoch 46**: Train 37.85%, Test 0.00%, Ξ±=0.4061, Loss=1.8099
|
| 228 |
+
- **Epoch 47**: Train 38.80%, Test 0.00%, Ξ±=0.4090, Loss=1.7620
|
| 229 |
+
- **Epoch 48**: Train 38.73%, Test 0.00%, Ξ±=0.4112, Loss=1.7839
|
| 230 |
+
- **Epoch 49**: Train 38.73%, Test 0.00%, Ξ±=0.4120, Loss=1.7659
|
| 231 |
+
- **Epoch 50**: Train 39.59%, Test 31.90%, Ξ±=0.4103, Loss=1.7749
|
| 232 |
|
| 233 |
### Training Milestones
|
| 234 |
+
- π **Ξ± β₯ 0.40** reached at epoch 40
|
|
|
|
|
|
|
| 235 |
|
| 236 |
---
|
| 237 |
|