Hugging Face's logo

j-llm
/
j96-tokenizer-v2

Japanese
sentencepiece
tokenizer
unigram
japanese
Model card Files
xet
 Community
j96-tokenizer-v2 / tokenizer.model
eightman999's picture
eightman999
Add j96-tokenizer-v2 (SentencePiece Unigram, vocab 96k)
2812003 verified
History Blame Contribute Delete
2.08 MB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
ac6ca431ceacd883d125cda46f632a038a2532b4bd840a9d2bb85d8b7e23a9c4
Size of remote file:
2.08 MB
·
SHA256:
bfa5f377c326782944f3c3679e4baa978899c33e4cec2e59addc4831d993e9eb

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.