Models

ibm-research/DAC.speech.v1.0

Updated Sep 19, 2024 • 7 • 15

pszemraj/sail-slimpajama-6B-32768-BPE-tokenizer

Updated Dec 29, 2025

gpwr/bark-it-tokenizer

Updated Nov 9, 2024

charanhu/kannada-tokenizer

Text Generation • Updated Nov 12, 2024 • 2

GlowCheese/minBERT

Text Classification • Updated Dec 4, 2024 • 1

AhmetSemih/tr_tokenizer

Updated Dec 26, 2024

aliarda/turkish_tokenizer

Updated Dec 3, 2024 • 1

aliarda/turkish_tokenizer_256k

Updated Dec 4, 2024 • 1

tejagowda/t5-hebrew-translation

Text Classification • 0.2B • Updated Dec 7, 2024 • 2

aloobun/IN-Llama-3-Tokenizer

Updated Mar 7, 2025

clearloop/tokenizer

Updated Jan 7, 2025

Saiteja/telugu-bpe

Updated Jan 5, 2025 • 4

aayushraina/hindi-bpe-tokenizer

Text Generation • Updated Jan 11, 2025

aayushraina/bpe-hindi

Text Generation • Updated Jan 11, 2025

physical-intelligence/fast

Robotics • Updated Jan 16, 2025 • 163

InterwebAlchemy/PGNTokenizer

Updated Feb 11, 2025 • 1

sachin6624/sachin-gpt2-tokenizer

Updated Feb 3, 2025 • 1

Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity

Updated Feb 18, 2025

Ornaments/72k-TK-BBPE-HF

Updated Feb 18, 2025

savath/laonlp-enhanced

Updated Feb 21, 2025

mishmish66/throwing_fast

Robotics • Updated Feb 28, 2025

Adiii143/code-search-net-tokenizer

Updated Mar 12, 2025

TuKoResearch/WavCochV8192

Feature Extraction • 11.1M • Updated 23 days ago • 91

mishmish66/trying-fast

Robotics • Updated Apr 22, 2025

deshanksuman/romanized-sinhala-tokenizer

Updated Sep 14, 2025

Namuun123/mn_sentencepiece_tokenizer

Updated Apr 25, 2025

luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_150k_20ep

2.17M • Updated May 9, 2025

luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_400k_30ep

2.17M • Updated May 9, 2025

ArabovMK/tajik-tokenizers-v1

Updated May 10, 2025

neghny/segmo

Updated May 15, 2025