minimind-instruct-135m / config.json
achavan1211's picture
Upload instruction-tuned MiniMind (137.7M params, step 1000)
33d751b verified
Raw
History Blame Contribute Delete
255 Bytes
{
"model_type": "minimind",
"vocab_size": 32000,
"n_embd": 768,
"n_layer": 12,
"n_head": 12,
"block_size": 512,
"dropout": 0.0,
"n_params": 137719296,
"architecture": "GPT-style decoder (pre-norm, GELU, absolute positional embeddings)"
}