File size: 1,253 Bytes
fabbcf9 c87a2c3 f91623d fabbcf9 f91623d fabbcf9 f91623d fabbcf9 f91623d c87a2c3 fabbcf9 dc551fe fabbcf9 dc551fe f91623d fabbcf9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
tags:
- image-classification
- cantor-fusion
- geometric-deep-learning
- safetensors
- vision-transformer
- warm-restarts
- geometric-coalescence
library_name: pytorch
datasets:
- cifar10
- cifar100
metrics:
- accuracy
---
# vit-beans-v3
**Geometric Deep Learning with Cantor Multihead Fusion + Shatter-Reconstruct Training**
This repository contains training runs using Cantor fusion architecture with:
- Pentachoron (5-simplex) structures for geometric routing
- CosineAnnealingWarmRestarts for exploration cycles
- GeometricCoalescenceLoss for shatter-reconstruct training
### 🚀 LR Boost + Geometric Coalescence
This run uses **restart_lr_mult = 1.15x** with **GeometricCoalescenceLoss**:
- LR boosts create aggressive exploration cycles
- Coalescence loss provides geometric scaffolding during weight thrashing
- Adaptive weighting: 0.1 → 0.8 during LR spikes
- Model reconstructs from geometric first principles when patterns shatter
## Current Run
**Latest**: `cifar100_weighted_ADAMW_WarmRestart_boost1.15x_coal0.5_20251124_152227`
- **Dataset**: CIFAR100
- **Fusion Mode**: weighted
- **Coalescence**: λ=0.5 ✓
- **LR Boost**: 1.15x 🚀
---
**Repository maintained by**: [@AbstractPhil](https://huggingface.co/AbstractPhil)
|