tiny_gpt_aviation / config.json
supriyo's picture
Add TinyGPT model
2f830c2
{
"vocab_size": 1565,
"n_embd": 128,
"block_size": 64,
"n_layer": 2,
"n_head": 4,
"model_type": "tiny-gpt"
}