Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
1
Licenses
Other
Reset Languages
English
Chinese
French
Spanish
German
Japanese
Korean
Portuguese
Italian
Russian
Hindi
Arabic
Thai
Turkish
multilingual
Vietnamese
Indonesian
Polish
Dutch
Romanian
Swedish
Ukrainian
Persian
Czech
Finnish
Bengali
Nepali
Danish
Greek
Hebrew
Malay
Tamil
Hungarian
Urdu
Bulgarian
Catalan
Telugu
Norwegian
French
Marathi
Swahili
Serbian
Slovak
Gujarati
Slovenian
Estonian
Burmese
Croatian
Tagalog
Malayalam
Lithuanian
Galician
Latvian
Khmer
Kannada
Basque
Icelandic
Panjabi
Amharic
Lao
Afrikaans
Kazakh
Mongolian
Georgian
Hausa
Assamese
Armenian
Welsh
Macedonian
Sinhala
Belarusian
Azerbaijani
Javanese
Uzbek
Yoruba
English
Irish
Sundanese
Albanian
Latin
Bosnian
Maltese
Somali
Sanskrit
Sindhi
Oriya
code
Spanish
Thai
Russian
+ 4789 languages
Apply filters
Models
251
Full-text search
Inference Available
Edit filters
Sort: Trending
Active filters:
bpe
Clear all
smcproject/malayalam-bpe-tokenizer
Updated
13 days ago
•
2
alibayram/magibu-q700m
0.7B
•
Updated
1 day ago
•
23
•
1
espnet/xeus
Automatic Speech Recognition
•
Updated
Jun 17, 2025
•
44
•
144
gsar78/Greek_Tokenizer
Updated
Aug 5, 2024
•
1
Acct2325449/asset-keywords-tokenizer
Updated
Sep 18, 2024
charanhu/kannada-tokenizer
Text Generation
•
Updated
Nov 12, 2024
•
2
aloobun/IN-Llama-3-Tokenizer
Updated
Mar 7, 2025
Saiteja/telugu-bpe
Updated
Jan 5, 2025
•
4
aayushraina/hindi-bpe-tokenizer
Text Generation
•
Updated
Jan 11, 2025
aayushraina/bpe-hindi
Text Generation
•
Updated
Jan 11, 2025
prithivMLmods/Bpe-vocab-n-OCR
Image-to-Text
•
Updated
May 3, 2025
•
4
•
4
mradermacher/Tokenized-OCR-GGUF
2B
•
Updated
Jul 31, 2025
•
69
•
1
mradermacher/Tokenized-OCR-i1-GGUF
2B
•
Updated
Jul 11, 2025
•
117
muzaffercky/kurdish-kurmanji-tokenizer
Updated
Jun 30, 2025
•
3
mradermacher/Bpe-vocab-n-OCR-GGUF
2B
•
Updated
Jul 31, 2025
•
596
mradermacher/Bpe-vocab-n-OCR-i1-GGUF
2B
•
Updated
Jul 11, 2025
•
145
•
1
Hailay/geez-tokenizer
Token Classification
•
Updated
Jul 15, 2025
Hengzongshu/Chinse_BBPE_Vocab
Text Classification
•
Updated
Jun 1, 2025
Vipplav/telugu-bpe-23k
Updated
Jun 19, 2025
Max1798/my-tokenizer
Updated
Jul 17, 2025
•
3
amirhofo/Persian-BPE-Tokenizer
Updated
Jul 24, 2025
yakul259/english-bpe-tokenizer-60k
Updated
Aug 14, 2025
yakul259/finance-bpe-tokenizer-30k
Updated
Aug 15, 2025
toksuite/common-pile-comma-v0.1
Text Generation
•
2B
•
Updated
Dec 25, 2025
•
4
toksuite/meta-llama-Llama-3.2-1B
Text Generation
•
2B
•
Updated
Dec 25, 2025
•
38
toksuite/microsoft-Phi-3-mini-4k-instruct
Text Generation
•
1B
•
Updated
Dec 25, 2025
•
18
toksuite/gpt2
Text Generation
•
1B
•
Updated
Dec 25, 2025
•
93
toksuite/bigscience-bloom
Text Generation
•
2B
•
Updated
Dec 25, 2025
•
103
MustafaSeker/sugartrq-tokenizer-tr
Updated
Sep 2, 2025
toksuite/mistralai-tekken
Text Generation
•
2B
•
Updated
Dec 25, 2025
•
17
Previous
1
2
3
...
9
Next