test-model / config.json
RuihaoQiu's picture
v0.1 simple model
0fd22ba verified
{
"model_type": "transformer",
"architecture": "bert-base",
"num_parameters": 110000000,
"vocab_size": 30522,
"hidden_size": 768,
"num_hidden_layers": 12,
"num_attention_heads": 12
}