pre_filtered.lg / tokenization.model
kushaltatariya's picture
Upload tokenizer
2d572a6 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
a3c6c08c747cdcce0015145cd59842ec6b0422203ff0f47c8e2ef5aed9d0cbf1
Pointer size:
131 Bytes
·
Size of remote file:
289 kB
·
Xet hash:
95f0c89b233af8bdcfb3dedc0e3dc4d659a74b768c61f6bec473e380f0b8be5b

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.