HarryPotterGPT / tokenizer_config.json
CamiloVega's picture
Upload improved HarryPotterGPT with better compatibility
6ec2e4a verified
raw
history blame contribute delete
186 Bytes
{
"model_type": "gpt2",
"bos_token": "[BOS]",
"eos_token": "[EOS]",
"unk_token": "[UNK]",
"pad_token": "[PAD]",
"do_lower_case": false,
"tokenizer_class": "GPT2Tokenizer"
}