OxideLLM_5M-tfjs / config.json
ULFBERTO's picture
Upload folder using huggingface_hub
31a1eda verified
{
"vocab_size": 221,
"d_model": 256,
"num_heads": 4,
"dff": 512,
"num_layers": 4,
"max_len": 128,
"dropout": 0.1
}