transformer-model / config.json
paudelanil's picture
Upload config.json with huggingface_hub
fb8f0d8 verified
raw
history blame contribute delete
227 Bytes
{
"num_encoder_layers": 6,
"num_decoder_layers": 6,
"d_model": 512,
"num_heads": 8,
"dff": 2048,
"input_vocab_size": 10000,
"target_vocab_size": 8200,
"max_seq_len": 50,
"dropout_rate": 0.1
}