multilingual-22-12 / tokenizer.json
nreimers's picture
add tokenizer
0d42b43
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
a1f892ddf62e4d4f3b0bfd8d921e2738b4d90bbf45dfcfa9250eb2a6bd5507b7
Pointer size:
133 Bytes
·
Size of remote file:
10.6 MB
·
Xet hash:
7906f2cf6762da4d028ed0597ee2796ae842f2e98009433d610933249d19f618

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.