vorushin
/

tpuchat

Model card Files Files and versions

tpuchat / tokenizer /tokenizer.pkl

vorushin's picture

Upload trained BPE tokenizer (vocab 32768)

186dd03 verified 3 months ago

history blame contribute delete

413 kB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: f7d8d5d0e46220d01306d89bd60e8477a5dc6fd4daa7914f38d98c05576fe5a6
Size of remote file:: 413 kB
SHA256:: 36ca79841b4203beb9d504c18e11ac7d301973982302ff4d233302bb1464c863

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.