tachiwin
/

tokenizer_256K

indigenous-languages

Model card Files Files and versions

tokenizer_256K / tokenizer.json

ljcamargo's picture

Upload tokenizer.json with huggingface_hub

a80ee18 verified 4 days ago

History Blame Contribute Delete

20.2 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 910a7e01b45747ada782d1b7d013da62728b436b98a6c80808701c10d2f35c4f
Size of remote file:: 20.2 MB
SHA256:: 306a00a9924178e2acc2991f88b0a8260272d631df523680735a377c3d5aa804

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.