Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ This is a custom decoder-only transformer model (GPT1-style) trained from scratc
|
|
| 23 |
- **Embedding Size**: 512
|
| 24 |
- **Heads**: 8
|
| 25 |
- **Feedforward Dim**: 2048
|
| 26 |
-
- **Sequence Length**:
|
| 27 |
- **Vocab Size**: 35,000
|
| 28 |
|
| 29 |
## Tokenizer
|
|
|
|
| 23 |
- **Embedding Size**: 512
|
| 24 |
- **Heads**: 8
|
| 25 |
- **Feedforward Dim**: 2048
|
| 26 |
+
- **Sequence Length**: 128
|
| 27 |
- **Vocab Size**: 35,000
|
| 28 |
|
| 29 |
## Tokenizer
|