pre_filtered.ny / tokenization.model
kushaltatariya's picture
Upload tokenizer
573b4d1 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
3a539ecab67d059186597c9f8ea022a19494a34ea58fde90e22de4a45cffe284
Pointer size:
131 Bytes
·
Size of remote file:
260 kB
·
Xet hash:
3a4465a282f6d05ac34234a0084f5da9c399080a89f3673d533ab0baa5b4aae2

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.