Shoonya / tokenizer_config.json
MandarapuMadhulatha's picture
Upload Shoonya Model v0.2 with DeepSeek CPU optimizations
8493c0e verified
raw
history blame contribute delete
156 Bytes
{
"model_type": "gpt2",
"vocab_size": 50257,
"padding_side": "right",
"truncation_side": "right",
"bos_token_id": 50256,
"eos_token_id": 50256
}