pre_filtered.sn / tokenization.model
kushaltatariya's picture
Upload tokenizer
1d374ed verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
fe173f10080e20aba492c2486f481a8857ad4c468e69efe2d0ac14e584fa9e1a
Pointer size:
131 Bytes
·
Size of remote file:
301 kB
·
Xet hash:
902d751986a845944583db19bb3dd156573de61cc1e3bc7ef35aeeb28aae6e61

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.