chronollm-2015 / config.json
fitleech's picture
Update config.json
a25071b verified
Raw
History Blame Contribute Delete
180 Bytes
{
"model_type": "ChronoGPT",
"vocab_size": 50304,
"num_layers": 52,
"num_heads": 12,
"model_dim": 1536,
"architectures": [
"GPT"
],
"torch_dtype": "bfloat16"
}