raw_wiki.ny / tokenization.model
kushaltatariya's picture
Upload tokenizer
d785412 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
0e633493321683c874e2888cdc2e2e4083d0fe8164dcd33b3befcdf60bde28f5
Pointer size:
131 Bytes
·
Size of remote file:
261 kB
·
Xet hash:
a6b2d4ae6e4912a476f473b3655f991daa17c9d4163fc66065688facc2e5aef1

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.