quality / model_config.json
shu4dev's picture
Upload 3 files
372a1a6 verified
raw
history blame contribute delete
205 Bytes
{
"vocab_size": 50000,
"context_length": 512,
"num_layers": 8,
"num_classes": 2,
"attn_pdrop": 0.1,
"d_ff": 2048,
"d_model": 512,
"num_heads": 8,
"residual_pdrop": 0.1
}