FFT-expanded-naive / tokenizer.json
DopeorNope's picture
Upload tokenizer
9f04aae verified
Invalid JSON: Unexpected token 'v', "version ht"... is not valid JSON
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
6a8aea3c0d5f86c40162ccedb193655083fbd7706a80c99037c59c6d79f32a0f
Pointer size:
133 Bytes
·
Size of remote file:
12.3 MB
·
Xet hash:
ce885862445ea8b37a21d77dca2b327ee0459bd9d4c37fe31244f5f2ee79e745

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.