ALIF-Base-100M / config.json
AliMuhammad73's picture
Upload model and tokenizer
d64b4c8 verified
{
"model_type": "llama",
"block_size": 1024,
"n_embd": 768,
"n_head": 12,
"n_layer": 12,
"vocab_size": 32000
}