Update README.md
Browse files
README.md
CHANGED
|
@@ -3,7 +3,7 @@ license: mit
|
|
| 3 |
---
|
| 4 |
|
| 5 |
Transformer Language Model (Character-level GPT)
|
| 6 |
-
A character-level Transformer language model built from scratch in PyTorch, based on Andrej Karpathy's "Let's Build GPT"
|
| 7 |
Model
|
| 8 |
A causal (autoregressive) Transformer that predicts the next character given up to 256 previous characters. The model uses multi-head self-attention with causal masking, ReLU feed-forward networks, LayerNorm, and residual connections.
|
| 9 |
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
Transformer Language Model (Character-level GPT)
|
| 6 |
+
A character-level Transformer language model built from scratch in PyTorch, based on Andrej Karpathy's "Let's Build GPT" tutorial. Trained on William Shakespeare's Coriolanus.
|
| 7 |
Model
|
| 8 |
A causal (autoregressive) Transformer that predicts the next character given up to 256 previous characters. The model uses multi-head self-attention with causal masking, ReLU feed-forward networks, LayerNorm, and residual connections.
|
| 9 |
|