raw_wiki.lg / tokenization.model
kushaltatariya's picture
Upload tokenizer
6609b61 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
43e9d0707676d1ac36282a9201718ca1f803806ef755b7723b7217da072c5c98
Pointer size:
131 Bytes
·
Size of remote file:
295 kB
·
Xet hash:
83e7deaa28e04db231a13652e57f34eed91ce5509d1a6ce18c4e321d4f2bcd06

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.