extenda / tokenizer.json
jmcinern's picture
Upload tokenizer
02ec90b verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
fd9940e320a71d922a4cd260acc23daaf05c85a8c385f63ec6b71a04f67dda5d
Pointer size:
133 Bytes
·
Size of remote file:
15.8 MB
·
Xet hash:
26231c2d93595c247b1aaa44c2d786833171abec5467d26115b2e1515e6e2a4c

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.