mesosfer-tokenizer / tokenizer /token_bytes.pt
Dummy9898's picture
Upload folder using huggingface_hub
7153539 verified
Download
History Blame Contribute Delete
264 kB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
62436c6771ab94502829fb89d7f89294f8b848c925ffbfc01fb9e00841fb98e7
Size of remote file:
264 kB
·
SHA256:
0427e26159bca0bc9f3f21d34e7204e4dbd6b3e0e12bb3046474485170cbaecd

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.