pre_filtered.ig / tokenization.model
kushaltatariya's picture
Upload tokenizer
e03db1a verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
9c68153d08b6b7cfabd756dc86f5aa82947f82dbd6c813717fccd42605789dfa
Pointer size:
131 Bytes
·
Size of remote file:
436 kB
·
Xet hash:
e01f3508f367da39c9618ca5a1aa78cc662696b6e3369c59d27d0a2d0932a4b0

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.