|
|
--- |
|
|
license: mit |
|
|
--- |
|
|
|
|
|
# It works BEAUTIFULLY |
|
|
|
|
|
HOLY **** this 500k param stack of linear layers hit 79% val. I mean it's just a linear head but still, it works really well and with only a fraction of the active neurons. |
|
|
|
|
|
I posted an updated train feed because I never expected it to work so well. |
|
|
|
|
|
# Prelim |
|
|
|
|
|
This is a prototype linear stack meant to benchmark the newest CantorLinear layer implementation. |
|
|
|
|
|
Preliminary MNIST trains show that CantorLinear embedded cantor-fingerprinted direct neuron learning mask with alpha weights; |
|
|
* increases accuracy by +-4% with commonly +2% over standard linear layers and reduces train time by about 4% worst -4% speed. |
|
|
|
|
|
|
|
|
Preliminary MNIST trains show that CantorConv with cantor-fingerprinted learning mask |
|
|
* Accuracy is nearly identical to traditional +-2% either way depending on noise |
|
|
|
|
|
I will be testing cantor resnet by feeding it imagenet orderly features from my repos to see how it fares. |
|
|
|
|
|
https://github.com/AbstractEyes/lattice_vocabulary/blob/master/src/geovocab2/train/model/layers/linear.py |
|
|
|
|
|
While testing this stack I have a prototype for a second cantor linear layer I'll be testing. |
