OneNeuralX1Tool-26M / config.json
aman3456's picture
Upload folder using huggingface_hub
7731803 verified
Raw
History Blame Contribute Delete
313 Bytes
{
"model_type": "encoder-decoder",
"vocab_size": 8192,
"hidden_size": 512,
"num_encoder_layers": 12,
"num_decoder_layers": 6,
"num_attention_heads": 8,
"num_key_value_heads": 4,
"max_loops": 4,
"num_experts": 4,
"expert_dim": 2048,
"architecture": "OneNeuralX1ToolV2",
"accuracy": 0.8583
}