demo / tokenizer_config.json
BinaryHK's picture
Upload 7 files
45fd0c7 verified
Raw History Blame Contribute Delete
142 Bytes
{
"tokenizer_class": "EvilTokenizer",
"auto_map": {
"AutoTokenizer": [
"tokenization_evil.EvilTokenizer",
null
]
}
}