cruxtok / t1_seed2 /tokenizer.pt

CruxTok (T1) and NCM baseline tokenizers trained on XSum

16772ec verified about 13 hours ago

350 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.