miniembed-product / config.json
surazbhandari's picture
Sync from GitHub Actions
d79e1fc verified
raw
history blame contribute delete
130 Bytes
{
"vocab_size": 50000,
"d_model": 256,
"num_heads": 4,
"num_layers": 4,
"d_ff": 1024,
"max_seq_len": 128
}