Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,9 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
| 4 |
# What is bert beatrix 200_000?
|
| 5 |
This is the first 200,000 sequence length bert experiment from my cantor research. Trained specifically with cantor attention routing as a mechanism. The proof is attached.
|
| 6 |
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
+
# Updated proofs available here if altered
|
| 5 |
+
https://github.com/AbstractEyes/lattice_vocabulary/blob/master/src/geovocab2/proofs/beatrix_rope.py
|
| 6 |
+
|
| 7 |
# What is bert beatrix 200_000?
|
| 8 |
This is the first 200,000 sequence length bert experiment from my cantor research. Trained specifically with cantor attention routing as a mechanism. The proof is attached.
|
| 9 |
|