pxl-tokenizer / tokenizer.json
kira's picture
Upload tokenizer
34bcd14 verified
Invalid JSON: Unexpected token 'v', "version ht"... is not valid JSON
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
f8f1dae4255c64e82607c0aaeccf332a3e11c730957ad6fe732a05d099a89791
Pointer size:
133 Bytes
·
Size of remote file:
15.5 MB
·
Xet hash:
6cc3e8e3fc8a6a079b6166c25824097e49b47e32250056c16a48bebc7b589c41

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.