HDTenEightyP commited on
Commit
be81fbd
·
verified ·
1 Parent(s): 285b5b1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -20,9 +20,9 @@ LLMs are all currently focused on becoming larger and larger, able to do more an
20
  ## Technical Information
21
  | | |
22
  |---------------------------------|----:|
23
- |Layers |10|
24
- |Heads |10|
25
- |Embeddings |640|
26
  |Context Window |1024 tokens|
27
  |Tokenizer |GPT-2 BPE|
28
 
 
20
  ## Technical Information
21
  | | |
22
  |---------------------------------|----:|
23
+ |Layers |12|
24
+ |Heads |12|
25
+ |Embeddings |768|
26
  |Context Window |1024 tokens|
27
  |Tokenizer |GPT-2 BPE|
28