File size: 245 Bytes
0b505b7
1
2
This is a decoder-only transformer language model trained from scratch on the TinyStories dataset. The model implements the standard transformer architecture (decoder only), with several modern enhancements for efficient training and inference.