Hugging Face's logo

wikilangs
/
tok

Text Generation
fastText
Toki Pona
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-constructed_auxlang
Model card Files
xet
Community
tok / tok_morph_tokenizer.json
omarkamali's picture
omarkamali
Upload all models and assets for tok (latest)
1726dc8 verified
raw
history contribute delete
800 kB
File too large to display, you can check the raw version instead.