topicnet-topnet-integrated / tokenizer_config.json
fxxkingusername's picture
Upload tokenizer_config.json with huggingface_hub
1d1d850 verified
{
"model_type": "topicnet_topnet_integrated",
"vocab_size": 10000,
"pad_token": "<pad>",
"unk_token": "<unk>",
"bos_token": "<s>",
"eos_token": "</s>"
}