TimothDevA
/

cruxtok

vector-quantization

Model card Files Files and versions

cruxtok / t0cap_seed2 /tokenizer.pt

TimothDevA's picture

CruxTok (T1) and NCM baseline tokenizers trained on XSum

16772ec verified about 14 hours ago

History Blame Contribute Delete

300 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 41dc87538f3cf67d4818a2210fa236b720ef959bb6bc93c0057a21b8dffb5519
Size of remote file:: 300 MB
SHA256:: df8a8bd682aa86f61d67a1b431210ca04c4fb00a8ba354d38f6119076659774f

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.