bashyaldhiraj2067
/

NepaliBPE_Tokenizer

Model card Files Files and versions

NepaliBPE_Tokenizer / tokenizer.json

bashyaldhiraj2067's picture

bashyaldhiraj2067

Add custom BPE tokenizer with special tokens

a7e2d11 verified 9 months ago

history contribute delete

2.81 MB

File too large to display, you can check the raw version instead.