pre_filtered.yo / tokenization.model
kushaltatariya's picture
Upload tokenizer
6a3891d verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
b24679bb20d6bbf3860318a04ddafd31c49bcb29fb98c505aad186eb671fddfa
Pointer size:
131 Bytes
·
Size of remote file:
316 kB
·
Xet hash:
409044c279f33b3d1c4c9053248858f4d6745fdb4be8e56394ebd838b18a6cbe

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.