tinystories-nanogpt / model_config.json
LickyArc's picture
Add nanoGPT TinyStories checkpoint + config
a2214c4 verified
Raw
History Blame Contribute Delete
173 Bytes
{
"vocab_size": 50257,
"block_size": 256,
"n_layer": 6,
"n_head": 6,
"n_embd": 384,
"dropout": 0.1,
"tokenizer": "gpt2",
"best_val_loss": 1.705165147781372
}