Hugging Face's logo

j-llm
/
j72-tokenizer-v2

Japanese
sentencepiece
tokenizer
unigram
japanese
Model card Files
xet
 Community
j72-tokenizer-v2 / tokenizer.model
eightman999's picture
eightman999
Add j72-tokenizer-v2 (SentencePiece Unigram, vocab 72k)
fe724c3 verified
History Blame Contribute Delete
1.5 MB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
81b0ca227b56df7db3a486c2adb9477d72e010d2075eac721cff954b018434f1
Size of remote file:
1.5 MB
·
SHA256:
6e55616b704ae26c05e2457c75500b01d19cfa2543878b20bf973267dc3465c3

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.