junaidamk
/

ml-tokenizer

Model card Files Files and versions

ml-tokenizer / tokenizer_config.json

junaidamk's picture

add tokenizer

4492408 almost 4 years ago

history blame contribute delete

46 Bytes

{"tokenizer_class": "PreTrainedTokenizerFast"}