Models

Shu-vi/Russian_wordpiece_tokenizer_32k

Updated Oct 10, 2025

Shu-vi/Russian_Unigram_Tokenizer_16k

Updated Oct 10, 2025

SherifAnar/russian-bpe-16k

Updated Oct 10, 2025

SherifAnar/russian-wordpiece-16k

Updated Oct 10, 2025

LingoIITGN/Ansh-256k

Updated Oct 13, 2025 • 2

rxmha125/Rx_Codex_Tokenizer

Text Generation • Updated Oct 12, 2025

LingoIITGN/Ansh-128k

Updated Oct 13, 2025

uzlm/alloma-8B-Base

Text Generation • 8B • Updated Oct 16, 2025 • 9 • 2

ivao0/voc

76.1M • Updated Oct 17, 2025 • 3.36k

lc2004/kronos_tokenizer_base_BTCUSDT_1h_finetune

Updated Oct 20, 2025 • 246

mjbommar/glaurung-binary-tokenizer-001

Feature Extraction • Updated Oct 20, 2025

faizack/kronos-btc-1hr-tokenizer

Updated Oct 23, 2025

lc2004/kronos_tokenizer_base_BTCUSDT_4h_finetune

Updated Oct 23, 2025 • 9

WilliamSong/qwen3-embedding-0.6b

Feature Extraction • 0.6B • Updated Oct 27, 2025 • 39

J-Raposo/code-search-net-tokenizer

Updated Oct 30, 2025

mjbommar/glaurung-binary-tokenizer-002

Feature Extraction • Updated Nov 13, 2025 • 1

frothywater/kanade-12.5hz

Updated 1 day ago • 144 • 5

frothywater/kanade-25hz

Updated 1 day ago • 102 • 2

Vyvo-Research/WavTokenizer-small-320-24k

Updated Nov 6, 2025

Vyvo-Research/WavTokenizer-small-600-24k

Updated Nov 6, 2025

Vyvo-Research/WavTokenizer-large-speech-75token

Updated Nov 6, 2025 • 8

Vyvo-Research/WavTokenizer-medium-speech-320-24k-v2

Updated Nov 6, 2025

pandurangpatil/sample-marathi-bpe-tokenizer

Updated Nov 7, 2025 • 1

OpenMachineAI/UnitronX-Tokenizer-32k-v1

Updated Nov 6, 2025

ansul90/hindi-bpe-tokenizer

Updated Nov 7, 2025

vnaren13/telugu-bpe-tokenizer

Updated Nov 8, 2025

Morton-Li/QiTianTokenizer-Tiny

Updated about 13 hours ago

Morton-Li/QiTianTokenizer-Base

Updated about 13 hours ago

Morton-Li/QiTianTokenizer-Medium

Updated about 13 hours ago

Morton-Li/QiTianTokenizer-Large

Updated about 13 hours ago