bench-labs
/

GCTokenizer-v1

Model card Files Files and versions

GCTokenizer-v1 / L /rules.json

wop's picture

Release GCT v1 consensus tokenizer

a6e44c6 verified 3 days ago

History Blame Contribute Delete

27.2 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 22c5f5312ed9c9d1f71c4834f313cc6bd5e86580ee6176a72a7533123b31f112
Size of remote file:: 27.2 MB
SHA256:: 03a6d2caef450e7c35e2a5ca217e1697d7375d2c6bca1b6ee0bc478b597d4b23

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.