TimothDevA
/

cruxtok

vector-quantization

Model card Files Files and versions

cruxtok / t0cap_matched /tokenizer.pt

TimothDevA's picture

CruxTok (T1) and NCM baseline tokenizers trained on XSum

16772ec verified about 14 hours ago

History Blame Contribute Delete

349 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 8bfdd516f06f975e55f3df473746fb6868784a49afcd5740a80a42a73b5e90bc
Size of remote file:: 349 MB
SHA256:: ec8fb5a39dfac60d8f0a540ec035e290ea09e02c3f9a528f83c06e844914fd40

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.