Hugging Face's logo

wikilangs
/
tok

Text Generation
fastText
Toki Pona
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-constructed_auxlang
Model card Files
xet
Community
tok / models /tokenizer /tok_tokenizer_64k.model
omarkamali's picture
omarkamali
Upload all models and assets for tok (latest)
1726dc8 verified
download
history blame contribute delete
1.31 MB
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
a6b6e37a5b47ff0cfedd6be219d62e24889321f1167d0207cb33ad08a03a0a5f
Pointer size:
132 Bytes
·
Size of remote file:
1.31 MB
·
Xet hash:
aaa227586cb640839d3f057b91207cbdaf751a8c4d4d28b042a370f65ee1bd57

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.