Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

1,665

Base only

Active filters: tokenizer

mrkwanzaa/functionalizer-100M-github-code-python-seed5

Text Generation • 97.7M • Updated Sep 23 • 348

Larsson31/mizo-tokenizer-32k

Text Generation • Updated Sep 17

wonhui-labs/swt-tokenizer

Token Classification • Updated Sep 17

konko/bornomala-bengali-tokenizer

Token Classification • Updated Sep 17

salmanhadli/medical-bpe-16k

Updated Sep 17 • 1

marin-community/marin-tokenizer-tools

Updated Sep 18 • 1

touati-kamel/darja-tokenizer-50m

Feature Extraction • Updated Sep 29

chorcat/rukh-tokenizer

upstage/solar-pro4-tokenizer

Updated Sep 21 • 2

Samai-sa/SamAI-Tokenizer

changmaulee/timemeshin-otm-tokenizer

nassimjp/LFM2.5-2.6B-Pashto-Zi-b

Text Generation • 3B • Updated Sep 22 • 153

nassimjp/Qwen3-VL-4B-Thinking-Pashto-Zi

Image-Text-to-Text • 4B • Updated Sep 26 • 1.43k

mradermacher/LFM2.5-2.6B-Pashto-Zi-b-GGUF

3B • Updated Sep 22 • 353 • 1

nassimjp/LFM2.5-2.6B-Pashto-Zi-b-GGUF

3B • Updated Sep 23 • 253

sayurio/bn-tokenizer-64k

Text Generation • Updated Sep 23 • 1

abcastor/small-llm-superbpe-8000-v2

Updated Sep 23 • 1

mariklolik/AraToken

interpretable-finetuning/qwen2.5-7b-unaliased

Text Generation • 8B • Updated Sep 26 • 214

interpretable-finetuning/qwen2.5-32b-unaliased

Text Generation • 33B • Updated Sep 24 • 158

KhadijaMir/P1_financial_news_headlines_CharBPETokenizer

perixai/perix-tokenizer-tr-49k

coderian/QraXAi-Turkish-Tok-50K

CharlieH512/km_tokenizer_ctx14_8x1000

10.8M • Updated Sep 29 • 35

aghasalim/siba-az-tokenizer

Updated Sep 26 • 1

junaid008/hindko-tokenizer

Updated Oct 1 • 3

ugurhandasdemir/hf_tokanizer

nassimjp/Qwen3-VL-2B-Thinking-Pashto-Plus

Image-Text-to-Text • 2B • Updated Sep 28 • 159

amphora/L16-V65536-chat-tokenizer

llingsch/phaedra