bench-labs
/

GCTokenizer-v1

Model card Files Files and versions

GCTokenizer-v1 / XL /rules.json

wop's picture

Release GCT v1 consensus tokenizer

a6e44c6 verified 4 days ago

History Blame Contribute Delete

49.9 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 0ab63672e55396012a315680a0554fd93a34ed148dd13405f20699b45d3818e6
Size of remote file:: 49.9 MB
SHA256:: 5aa8c5ffb41d21abbcc1cc9606fe3d91bfd8eb561feb379a7865074753c26f6d

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.