raw_wiki.tn / tokenization.model
kushaltatariya's picture
Upload tokenizer
949767b verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
f321491edf6312bb0da114675d3ef1e4a713bc5e28e1abcfc100dde769bd7688
Pointer size:
131 Bytes
·
Size of remote file:
275 kB
·
Xet hash:
ba20f574c11dbfae88caede0701b5771f1d2c44e2edd52db62bdfaadfabfa4ed

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.