tpuchat / tokenizer /tokenizer.pkl
vorushin's picture
Upload trained BPE tokenizer (vocab 32768)
186dd03 verified
download
history blame contribute delete
413 kB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
f7d8d5d0e46220d01306d89bd60e8477a5dc6fd4daa7914f38d98c05576fe5a6
Size of remote file:
413 kB
·
SHA256:
36ca79841b4203beb9d504c18e11ac7d301973982302ff4d233302bb1464c863

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.