bench-labs
/

GCTokenizer-v1

Model card Files Files and versions

GCTokenizer-v1 / M /rules.json

wop's picture

Release GCT v1 consensus tokenizer

a6e44c6 verified 4 days ago

History Blame Contribute Delete

14.7 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 1363524aa08504834bdbbc59670d0401249e6137ba8602fe40f404586b55a187
Size of remote file:: 14.7 MB
SHA256:: 099a776c87611758ac1717b7ded723981958a0bf014f42407d126b8849dfd549

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.