reindexed-tekken / tiktoken /tokenizer.model
gsaltintas's picture
Upload folder using huggingface_hub
f71eed7 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
64a081edb3cbb8639a4eea9a7135ab9a0467c50676c672b217ba655f4d50e127
Pointer size:
132 Bytes
·
Size of remote file:
2.27 MB
·
Xet hash:
0784a674e0310eccca01f727ff7e585a1a2b246b43810a848667c53fc8e44912

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.