tinystories-minigpt / config.json
kryln's picture
Upload TinyStories MiniGPT model
17e48e4 verified
Raw
History Blame Contribute Delete
250 Bytes
{
"model_type": "minigpt",
"vocab_size": 72,
"n_embd": 256,
"n_head": 8,
"n_layer": 6,
"block_size": 128,
"dropout": 0.1,
"torch_dtype": "float32",
"architectures": [
"MiniGPTForCausalLM"
],
"transformers_version": "4.0.0"
}