smartcore-v1 / tokenizer /tokenizer.model
kdirgul's picture
Faz 0: 48K EN+TR SentencePiece tokenizer (frozen)
505e70d verified
Download
History Blame Contribute Delete
843 kB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
55e587d9ccdcf7e33104585ce2eb6692da176c6ef6f26e28f6e465e42e7120ae
Size of remote file:
843 kB
·
SHA256:
66cbdcf1bacb1b4e904557a516ba46825c0513748acc3f5ea7d10bf4515f7704

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.