prince-canuma
/

Kimi-K3-tokenizer

Model card Files Files and versions

Kimi-K3-tokenizer / tokenizer.json

prince-canuma's picture

Match tiktoken long-input chunking

2f96d6c verified 4 days ago

History Blame Contribute Delete

19.6 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 18cab4301473756283aa23b9bdb869dbfe2b9a4b1a192f29e5ff3686b34c5219
Size of remote file:: 19.6 MB
SHA256:: ce58bf13ad8925a62b33f6543438807b6ee7a957c6302a50063771431d2cb72c

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.