Update README.md
Browse files
README.md
CHANGED
|
@@ -20,9 +20,9 @@ LLMs are all currently focused on becoming larger and larger, able to do more an
|
|
| 20 |
## Technical Information
|
| 21 |
| | |
|
| 22 |
|---------------------------------|----:|
|
| 23 |
-
|Layers |
|
| 24 |
-
|Heads |
|
| 25 |
-
|Embeddings |
|
| 26 |
|Context Window |1024 tokens|
|
| 27 |
|Tokenizer |GPT-2 BPE|
|
| 28 |
|
|
|
|
| 20 |
## Technical Information
|
| 21 |
| | |
|
| 22 |
|---------------------------------|----:|
|
| 23 |
+
|Layers |12|
|
| 24 |
+
|Heads |12|
|
| 25 |
+
|Embeddings |768|
|
| 26 |
|Context Window |1024 tokens|
|
| 27 |
|Tokenizer |GPT-2 BPE|
|
| 28 |
|