scandeng-tokenizer / sentencepiece.model
versae's picture
SentencePiece byte fallback 32k
5230060
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
43fe9f6873b1e19fb09df7d7ee9ab5f4ccef55ba845c94f8613ed705c6c769e3
Pointer size:
131 Bytes
·
Size of remote file:
770 kB
·
Xet hash:
16c3d2f774108f244b18edae3f8cc90f8924a969e1d1466399d3be457ec520d6

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.