ByteSpanTokenisers
/

tokenizers

Model card Files Files and versions

tokenizers / frequency_256000 /tokenizer.json

codebyzeb's picture

Upload folder using huggingface_hub

6b0e22b verified 12 months ago

20.3 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 19fbc6eba787398546038bd5b92411f02958e5e98a93f3886de8bc99934aecd3
Size of remote file:: 20.3 MB
SHA256:: ed37c183a6fdf658a259f23b64ca57aab65a1b96dbcb8343b06e108fe6fbec55

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.