AbstractPhil commited on
Commit
fabbcf9
Β·
verified Β·
1 Parent(s): 46f516a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +113 -0
README.md ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - image-classification
4
+ - cantor-fusion
5
+ - geometric-deep-learning
6
+ - safetensors
7
+ - vision-transformer
8
+ library_name: pytorch
9
+ datasets:
10
+ - cifar10
11
+ - cifar100
12
+ metrics:
13
+ - accuracy
14
+ ---
15
+
16
+ # vit-beans-v3
17
+
18
+ **Geometric Deep Learning with Cantor Multihead Fusion**
19
+
20
+ This repository contains multiple training runs using Cantor fusion architecture with pentachoron structures and geometric routing. All models use SafeTensors format for security.
21
+
22
+ ## Repository Structure
23
+ ```
24
+ vit-beans-v3/
25
+ β”œβ”€β”€ runs/
26
+ β”‚ β”œβ”€β”€ cifar10_weighted_TIMESTAMP/
27
+ β”‚ β”‚ β”œβ”€β”€ checkpoints/
28
+ β”‚ β”‚ β”‚ β”œβ”€β”€ best_model.safetensors
29
+ β”‚ β”‚ β”‚ β”œβ”€β”€ best_training_state.pt
30
+ β”‚ β”‚ β”‚ └── best_metadata.json
31
+ β”‚ β”‚ β”œβ”€β”€ tensorboard/
32
+ β”‚ β”‚ β”œβ”€β”€ config.yaml
33
+ β”‚ β”‚ └── README.md
34
+ β”‚ β”œβ”€β”€ cifar100_consciousness_TIMESTAMP/
35
+ β”‚ β”‚ └── ...
36
+ β”‚ └── ...
37
+ └── README.md (this file)
38
+ ```
39
+
40
+ ## Current Run
41
+
42
+ **Latest**: `cifar100_consciousness_20251119_045425`
43
+ - **Dataset**: CIFAR100
44
+ - **Fusion Mode**: consciousness
45
+ - **Architecture**: 6 blocks, 8 heads
46
+ - **Simplex**: 4-simplex (5 vertices)
47
+
48
+ ## Architecture
49
+
50
+ The Cantor Fusion architecture uses:
51
+ - **Geometric Routing**: Pentachoron (5-simplex) structures for token routing
52
+ - **Cantor Multihead Fusion**: Multiple fusion heads with geometric attention
53
+ - **Beatrix Consciousness Routing**: Optional consciousness-aware token fusion using the Devil's Staircase
54
+ - **SafeTensors Format**: All model weights use SafeTensors (not pickle) for security
55
+
56
+ ## Usage
57
+
58
+ ### Download a Model
59
+ ```python
60
+ from huggingface_hub import hf_hub_download
61
+ from safetensors.torch import load_file
62
+ import torch
63
+
64
+ # Download model weights
65
+ model_path = hf_hub_download(
66
+ repo_id="AbstractPhil/vit-beans-v3",
67
+ filename="runs/YOUR_RUN_NAME/checkpoints/best_model.safetensors"
68
+ )
69
+
70
+ # Load weights (SafeTensors - no pickle!)
71
+ state_dict = load_file(model_path)
72
+ model.load_state_dict(state_dict)
73
+ ```
74
+
75
+ ### Browse Runs
76
+
77
+ Each run directory contains:
78
+ - `checkpoints/` - Model weights (safetensors), training state, metadata
79
+ - `tensorboard/` - TensorBoard logs for visualization
80
+ - `config.yaml` - Complete training configuration
81
+ - `README.md` - Run-specific details and results
82
+
83
+ ## Model Variants
84
+
85
+ - **Weighted Fusion**: Standard geometric fusion with learned weights
86
+ - **Consciousness Fusion**: Uses Beatrix routing with consciousness emergence
87
+
88
+ ## Citation
89
+ ```bibtex
90
+ @misc{vit_beans_v3,
91
+ author = {AbstractPhil},
92
+ title = {vit-beans-v3: Geometric Deep Learning with Cantor Fusion},
93
+ year = {2025},
94
+ publisher = {HuggingFace},
95
+ url = {https://huggingface.co/AbstractPhil/vit-beans-v3}
96
+ }
97
+ ```
98
+
99
+ ## Training Details
100
+
101
+ All models trained with:
102
+ - Optimizer: AdamW
103
+ - Mixed Precision: Available on A100
104
+ - Augmentation: AutoAugment (CIFAR10 policy)
105
+ - Format: SafeTensors (ClamAV safe)
106
+
107
+ Built with geometric consciousness-aware routing using the Devil's Staircase (Beatrix) and pentachoron parameterization.
108
+
109
+ ---
110
+
111
+ **Repository maintained by**: [@AbstractPhil](https://huggingface.co/AbstractPhil)
112
+
113
+ **Latest update**: 2025-11-19 04:54:47