AbstractPhil commited on
Commit
0f4ac53
·
verified ·
1 Parent(s): 93e5078

Update beatrix-cifar100_20251007_215344 - Epoch 0 - Acc: 0.0732

Browse files
README.md CHANGED
@@ -44,25 +44,26 @@ When train accuracy exceeds validation accuracy by 2% or more, the system automa
44
  | beatrix-cifar100 | 20251007_195812 | 0.4701 | 42 | `weights/beatrix-cifar100/20251007_195812` | `logs/beatrix-cifar100/20251007_195812` |
45
  | beatrix-cifar100 | 20251007_203741 | 0.4324 | 40 | `weights/beatrix-cifar100/20251007_203741` | `logs/beatrix-cifar100/20251007_203741` |
46
  | beatrix-cifar100 | 20251007_193112 | 0.2802 | 10 | `weights/beatrix-cifar100/20251007_193112` | `N/A` |
 
47
 
48
 
49
- ## Latest Updated Model: beatrix-cifar100 (Session: 20251007_203741)
50
 
51
  ### Model Details
52
 
53
  - **Architecture**: Vision Transformer with fractal positional encoding
54
  - **Dataset**: CIFAR-100 (100 classes)
55
- - **Embedding Dimension**: 256
56
  - **Depth**: 12 layers
57
  - **Patch Size**: 4x4
58
  - **PE Levels**: 12
59
- - **Simplex Dimension**: 4-simplex
60
 
61
  ### Training Details
62
 
63
- - **Training Session**: 20251007_203741
64
- - **Best Accuracy**: 0.4324
65
- - **Epochs Trained**: 40
66
  - **Batch Size**: 512
67
  - **Learning Rate**: 0.0001
68
  - **Adaptive Augmentation**: Enabled
@@ -78,7 +79,7 @@ When train accuracy exceeds validation accuracy by 2% or more, the system automa
78
 
79
  Training logs are available in the repository at:
80
  ```
81
- logs/beatrix-cifar100/20251007_203741
82
  ```
83
 
84
  To view them locally:
@@ -87,7 +88,7 @@ To view them locally:
87
  git clone https://huggingface.co/AbstractPhil/vit-beatrix
88
 
89
  # View logs in TensorBoard
90
- tensorboard --logdir vit-beatrix/logs/beatrix-cifar100/20251007_203741
91
  ```
92
 
93
  ## Usage
@@ -135,14 +136,14 @@ for key, info in sorted(manifest.items(), key=lambda x: x[1]['accuracy'], revers
135
  # Download weights for the latest training session of beatrix-cifar100
136
  weights_path = hf_hub_download(
137
  repo_id="AbstractPhil/vit-beatrix",
138
- filename="weights/beatrix-cifar100/20251007_203741/model.safetensors"
139
  )
140
 
141
  # Load model
142
  model = SimplifiedGeometricClassifier(
143
  num_classes=100,
144
  img_size=32,
145
- embed_dim=256,
146
  depth=12
147
  )
148
 
 
44
  | beatrix-cifar100 | 20251007_195812 | 0.4701 | 42 | `weights/beatrix-cifar100/20251007_195812` | `logs/beatrix-cifar100/20251007_195812` |
45
  | beatrix-cifar100 | 20251007_203741 | 0.4324 | 40 | `weights/beatrix-cifar100/20251007_203741` | `logs/beatrix-cifar100/20251007_203741` |
46
  | beatrix-cifar100 | 20251007_193112 | 0.2802 | 10 | `weights/beatrix-cifar100/20251007_193112` | `N/A` |
47
+ | beatrix-cifar100 | 20251007_215344 | 0.0732 | 0 | `weights/beatrix-cifar100/20251007_215344` | `logs/beatrix-cifar100/20251007_215344` |
48
 
49
 
50
+ ## Latest Updated Model: beatrix-cifar100 (Session: 20251007_215344)
51
 
52
  ### Model Details
53
 
54
  - **Architecture**: Vision Transformer with fractal positional encoding
55
  - **Dataset**: CIFAR-100 (100 classes)
56
+ - **Embedding Dimension**: 512
57
  - **Depth**: 12 layers
58
  - **Patch Size**: 4x4
59
  - **PE Levels**: 12
60
+ - **Simplex Dimension**: 5-simplex
61
 
62
  ### Training Details
63
 
64
+ - **Training Session**: 20251007_215344
65
+ - **Best Accuracy**: 0.0732
66
+ - **Epochs Trained**: 0
67
  - **Batch Size**: 512
68
  - **Learning Rate**: 0.0001
69
  - **Adaptive Augmentation**: Enabled
 
79
 
80
  Training logs are available in the repository at:
81
  ```
82
+ logs/beatrix-cifar100/20251007_215344
83
  ```
84
 
85
  To view them locally:
 
88
  git clone https://huggingface.co/AbstractPhil/vit-beatrix
89
 
90
  # View logs in TensorBoard
91
+ tensorboard --logdir vit-beatrix/logs/beatrix-cifar100/20251007_215344
92
  ```
93
 
94
  ## Usage
 
136
  # Download weights for the latest training session of beatrix-cifar100
137
  weights_path = hf_hub_download(
138
  repo_id="AbstractPhil/vit-beatrix",
139
+ filename="weights/beatrix-cifar100/20251007_215344/model.safetensors"
140
  )
141
 
142
  # Load model
143
  model = SimplifiedGeometricClassifier(
144
  num_classes=100,
145
  img_size=32,
146
+ embed_dim=512,
147
  depth=12
148
  )
149
 
logs/beatrix-cifar100/20251007_215344/events.out.tfevents.1759874026.f41d735e1a7f.86975.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff14edc4c88ee4f9ca0a9379cce5560e848637b531dd54619bc261ff9a264da4
3
+ size 88
manifest.json CHANGED
@@ -43,5 +43,17 @@
43
  "depth": 12,
44
  "batch_size": 512,
45
  "learning_rate": 0.0001
 
 
 
 
 
 
 
 
 
 
 
 
46
  }
47
  }
 
43
  "depth": 12,
44
  "batch_size": 512,
45
  "learning_rate": 0.0001
46
+ },
47
+ "beatrix-cifar100_20251007_215344": {
48
+ "accuracy": 0.0732077207416296,
49
+ "epoch": 0,
50
+ "timestamp": "20251007_215344",
51
+ "model_name": "beatrix-cifar100",
52
+ "path": "weights/beatrix-cifar100/20251007_215344",
53
+ "logs_path": "logs/beatrix-cifar100/20251007_215344",
54
+ "embed_dim": 512,
55
+ "depth": 12,
56
+ "batch_size": 512,
57
+ "learning_rate": 0.0001
58
  }
59
  }
weights/beatrix-cifar100/20251007_215344/config.json ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "num_classes": 100,
3
+ "img_size": 32,
4
+ "patch_size": 4,
5
+ "embed_dim": 512,
6
+ "k_simplex": 5,
7
+ "depth": 12,
8
+ "num_heads": 8,
9
+ "mlp_ratio": 4.0,
10
+ "dropout": 0.0,
11
+ "pe_levels": 12,
12
+ "pe_features_per_level": 2,
13
+ "pe_smooth_tau": 0.25,
14
+ "simplex_feature_weight": 0.5,
15
+ "batch_size": 512,
16
+ "num_epochs": 50,
17
+ "learning_rate": 0.0001,
18
+ "weight_decay": 0.005,
19
+ "warmup_epochs": 10,
20
+ "task_loss_weight": 0.5,
21
+ "flow_loss_weight": 0.5,
22
+ "coherence_loss_weight": 0.3,
23
+ "multiscale_loss_weight": 0.2,
24
+ "volume_reg_weight": 0.1,
25
+ "use_adaptive_augmentation": true,
26
+ "overfit_threshold": 0.02,
27
+ "mixup_alpha": 0.2,
28
+ "cutmix_alpha": 1.0,
29
+ "device": "cuda",
30
+ "num_workers": 4,
31
+ "pin_memory": true,
32
+ "save_dir": "./checkpoints",
33
+ "save_every": 10,
34
+ "use_safetensors": true,
35
+ "timestamp_dirs": true,
36
+ "push_to_hub": true,
37
+ "hub_model_id": "AbstractPhil/vit-beatrix",
38
+ "hub_model_name": "beatrix-cifar100",
39
+ "hub_upload_best_only": true,
40
+ "hub_upload_every_n_epochs": 10,
41
+ "use_tensorboard": true,
42
+ "log_dir": "./logs",
43
+ "log_every": 50,
44
+ "train_baseline": false
45
+ }
weights/beatrix-cifar100/20251007_215344/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d25204c989c7e9368ea47cb406fbe8d84e53edcae141bf9eb6f2beb72f26361
3
+ size 151716908