junaidamk
/

ml-bpetokenizer

Model card Files Files and versions

ml-bpetokenizer / tokenizer_config.json

junaidamk's picture

add tokenizer

9e5697e almost 4 years ago

history blame contribute delete

46 Bytes

{"tokenizer_class": "PreTrainedTokenizerFast"}