Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
bmeyer2025
/
tiny-gpt-shakespeare
like
0
Text Generation
PyTorch
tiny-shakespeare
English
transformer
language-model
from-scratch
educational
shakespeare
rope
swiglu
rmsnorm
kv-cache
arxiv:
2104.09864
arxiv:
2002.05202
arxiv:
1910.07467
License:
mit
Model card
Files
Files and versions
xet
Community
main
tiny-gpt-shakespeare
/
config.json
bmeyer2025
Upload config.json with huggingface_hub
9508da5
verified
6 days ago
raw
Copy download link
history
blame
contribute
delete
113 Bytes
{
"vocab_size"
:
50257
,
"n_embd"
:
384
,
"n_heads"
:
6
,
"n_layer"
:
6
,
"block_size"
:
256
,
"dropout"
:
0.0
}