safeai-tutor-0096 / config.json
ajm19826's picture
Create config.json
09a7beb verified
raw
history blame contribute delete
189 Bytes
{
"model_type": "gpt2",
"vocab_size": 32000,
"n_positions": 1024,
"n_ctx": 1024,
"n_embd": 512,
"n_layer": 12,
"n_head": 8,
"bos_token_id": 50256,
"eos_token_id": 50256
}