Update README.md
Browse files
README.md
CHANGED
|
@@ -6,4 +6,4 @@ language:
|
|
| 6 |
---
|
| 7 |
GLORT2 (GLORT2 Low Rank Transformer Transformer) is a transformer model where every single linear layer is another smaller transformer model
|
| 8 |
|
| 9 |
-
also sorry I just realized theres some residual from where I copied the model code from in my own projects that includes some "expanded lm head size" stuff just ignore that if you're looking at the config and code
|
|
|
|
| 6 |
---
|
| 7 |
GLORT2 (GLORT2 Low Rank Transformer Transformer) is a transformer model where every single linear layer is another smaller transformer model
|
| 8 |
|
| 9 |
+
also sorry I just realized theres some residual from where I copied the model code from in my own projects that includes some "expanded lm head size" stuff just ignore that if you're looking at the config and code this isn't a serious project so I don't care too much that it's there
|