llamalized-midm-tokenizer / tokenizer.model
StatPan's picture
Upload tokenizer
310b0e6
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
98789fa1bf89a1f9692889fb4a0029d3d096a9109cebf4f6bce1a255f2701378
Pointer size:
132 Bytes
·
Size of remote file:
1.46 MB
·
Xet hash:
09b9b7e036fb8258a61fee3dfbe4cc88b1c4b490889ae641b0333a1dbd2766c1

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.