pre_filtered.tn / tokenization.model
kushaltatariya's picture
Upload tokenizer
915e423 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
afa8bacabf1b68046c031dfbb3029f1d476f1ec897be858e87eaaa0547306f01
Pointer size:
131 Bytes
·
Size of remote file:
272 kB
·
Xet hash:
b0fec4d2919726b7f6b4fd5e6d31296266dc9ab2b649bd778225a615dcaf7403

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.