mesosfer-tokenizer / tokenizer /tokenizer.pkl
Dummy9898's picture
Upload folder using huggingface_hub
7153539 verified
Download
History Blame Contribute Delete
836 kB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
531f745f5893eeeab8f82241ab0fe15fd6461c2a6f27b11c6f38b42e97011f67
Size of remote file:
836 kB
·
SHA256:
b7be4434d3d4f12215bba3755a73db0467d038ea566300476ef949d677a76a8f

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.