dichter-denker / config.json
mtkl6's picture
Add config.json (architecture metadata + download tracking)
01e5ec6 verified
Raw
History Blame Contribute Delete
330 Bytes
{
"model_type": "gpt",
"architectures": ["GPTLanguageModel"],
"vocab_size": 8192,
"n_layer": 12,
"n_head": 8,
"n_embd": 512,
"block_size": 512,
"dropout": 0.2,
"tie_word_embeddings": true,
"tokenizer_file": "tokenizer.json",
"weights_file": "chat_model.pt",
"library_name": "pytorch",
"language": "de"
}