tpuchat / tokenizer /token_bytes.pt
vorushin's picture
Upload trained BPE tokenizer (vocab 32768)
186dd03 verified
download
history blame contribute delete
133 kB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
4841355a530771aca23ef9878a128dc1cb0bc545e1d790ae14097ff4eabc4d01
Size of remote file:
133 kB
·
SHA256:
6b293b04ec1bda26b2f745e5dbb2df2ad4149eb56977a1afbb69f6712c58d24c

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.