krushna-gpt / config.json
krushna-dash's picture
Upload krushna-gpt weights, config, and tokenizer
3c4be88 verified
Raw
History Blame Contribute Delete
258 Bytes
{
"model_type": "krushna-gpt",
"vocab_size": 568,
"context_length": 128,
"model_dim": 128,
"num_blocks": 4,
"num_heads": 4,
"architecture": "decoder-only transformer",
"tokenizer": "BPE (custom, trained on corpus)",
"framework": "pytorch"
}