Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ This showcases the direct causal response by testing how well the model can repr
|
|
| 10 |
|
| 11 |
|
| 12 |
# Experimentation Head
|
| 13 |
-
Everything led to the RoPE enhancement.
|
| 14 |
|
| 15 |
This is proof for the baseline of this concept. The foundational math works.
|
| 16 |
Everything relational to this behavior is to be expanded directly into a full wide bert with the relational complexity of a standard bert.
|
|
|
|
| 10 |
|
| 11 |
|
| 12 |
# Experimentation Head
|
| 13 |
+
Everything led to the RoPE enhancement. Simply drop the trainer into a colab cell on an a100 80 gb and start it up.
|
| 14 |
|
| 15 |
This is proof for the baseline of this concept. The foundational math works.
|
| 16 |
Everything relational to this behavior is to be expanded directly into a full wide bert with the relational complexity of a standard bert.
|