NanoGPT-Base3 / config.json
armenjeddi's picture
Add base gpt2 model with 3 layers
07ebdbd verified
{
"architectures": [
"BaseGPTForCausalLM"
],
"auto_map": {
"AutoConfig": "modeling_base.GPTConfig",
"AutoModelForCausalLM": "modeling_base.BaseGPTForCausalLM"
},
"dtype": "bfloat16",
"model_type": "base",
"transformers_version": "4.57.0"
}