Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
hafeez007
/
balochi-tokenizers
like
0
Text Generation
balochiml/balochi-dedup-corpus
Baluchi
English
sentencepiece
tokenizer
wordpiece
bpe
balochi
southern-balochi
low-resource-nlp
perso-arabic
nlp
gemma
bert
roberta
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
balochi-tokenizers
/
Tokens
1.99 MB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
hafeez007
Update tokenizer models and README
e899795
verified
30 days ago
Balochi_Labzank.txt
Safe
32.3 kB
Update tokenizer models and README
30 days ago
Tahir Hakim.txt
Safe
32.3 kB
Update tokenizer models and README
30 days ago
liberal capitalism.txt
Safe
41.6 kB
Update tokenizer models and README
30 days ago
tokens_30k_balochi.txt
Safe
55 kB
Update tokenizer models and README
30 days ago
tokens_arabert_v2.txt
Safe
41.2 kB
Update tokenizer models and README
30 days ago
tokens_aragpt2.txt
Safe
120 kB
Update tokenizer models and README
30 days ago
tokens_arbert.txt
Safe
66.2 kB
Update tokenizer models and README
30 days ago
tokens_balochi_30k.txt
Safe
54.2 kB
Update tokenizer models and README
30 days ago
tokens_balochi_bpe.txt
Safe
47 kB
Update tokenizer models and README
30 days ago
tokens_balochi_bpe_128k.txt
Safe
46.9 kB
Update tokenizer models and README
30 days ago
tokens_balochi_bpe_32k.txt
Safe
47.5 kB
Update tokenizer models and README
30 days ago
tokens_balochi_bpe_47k.txt
Safe
47.3 kB
Update tokenizer models and README
30 days ago
tokens_balochi_bpe_64k.txt
Safe
47.2 kB
Update tokenizer models and README
30 days ago
tokens_balochi_bpe_80k.txt
Safe
47 kB
Update tokenizer models and README
30 days ago
tokens_balochi_sentencepiece.txt
Safe
62.1 kB
Update tokenizer models and README
30 days ago
tokens_balochi_sp_128k.txt
Safe
61.9 kB
Update tokenizer models and README
30 days ago
tokens_balochi_sp_32k.txt
Safe
62.5 kB
Update tokenizer models and README
30 days ago
tokens_balochi_sp_47k.txt
Safe
62.3 kB
Update tokenizer models and README
30 days ago
tokens_balochi_sp_64k.txt
Safe
62.1 kB
Update tokenizer models and README
30 days ago
tokens_balochi_sp_80k.txt
Safe
62 kB
Update tokenizer models and README
30 days ago
tokens_balochi_wordpiece.txt
Safe
47.9 kB
Update tokenizer models and README
30 days ago
tokens_balochi_wp_128k.txt
Safe
47.2 kB
Update tokenizer models and README
30 days ago
tokens_balochi_wp_32k.txt
Safe
48.5 kB
Update tokenizer models and README
30 days ago
tokens_balochi_wp_47k.txt
Safe
48.1 kB
Update tokenizer models and README
30 days ago
tokens_balochi_wp_64k.txt
Safe
47.9 kB
Update tokenizer models and README
30 days ago
tokens_balochi_wp_80k.txt
Safe
47.6 kB
Update tokenizer models and README
30 days ago
tokens_bert.txt
Safe
71.7 kB
Update tokenizer models and README
30 days ago
tokens_bert_multilingual.txt
Safe
68.3 kB
Update tokenizer models and README
30 days ago
tokens_camelbert_msa.txt
Safe
72.4 kB
Update tokenizer models and README
30 days ago
tokens_gemma.txt
Safe
73.8 kB
Update tokenizer models and README
30 days ago
tokens_nltk.txt
Safe
46.2 kB
Update tokenizer models and README
30 days ago
tokens_parsbert.txt
Safe
55.4 kB
Update tokenizer models and README
30 days ago
tokens_persian_bpe.txt
Safe
0 Bytes
Update tokenizer models and README
30 days ago
tokens_persianbert_fa.txt
Safe
57 kB
Update tokenizer models and README
30 days ago
tokens_urdubert.txt
Safe
161 kB
Update tokenizer models and README
30 days ago
