openwebtext-196k-tokenizer / tokenizer.json
gartland's picture
Upload tokenizer
ec9d7a7 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
2c471637da078881696b33c811e3aa443570aad60bd69546840b8596a6363600
Pointer size:
133 Bytes
·
Size of remote file:
14.3 MB
·
Xet hash:
0743c1e842d59491a862dcaa195dfc1181837ee881f1dce64cfe0490012d292f

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.