SurendraVB
/

omni-tokenizer

binary-analysis

Model card Files Files and versions

omni-tokenizer / tokenizer_config.json

SurendraVB's picture

Initial release of the 539k Omni-Tokenizer

a987355 verified about 11 hours ago

History Blame Contribute Delete

76.1 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 097c7f27b5766daa9d0e3a8b586c7177a660107f5f197c2057e40dc454e314f2
Size of remote file:: 76.1 MB
SHA256:: 5d210f0eccc43ea40d02beb2f40977070d0b1637f3c17364ef98a87a65033a50

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.