shahbakhsh
/

balochi-tokenizer

Model card Files Files and versions

balochi-tokenizer / tokenizer.json

shahbakhsh's picture

Upload best Balochi tokenizer: hf_bpe (vocab=48000)

46629ba verified 14 days ago

History Contribute Delete

3.65 MB

File too large to display, you can check the raw version instead.