Hugging Face's logo

TimothDevA
/
cruxtok

English
tokenizer
vector-quantization
residual-vq
Model card Files
xet
 Community
cruxtok / t1_seed42

Commit History

Yesterday

  1. CruxTok (T1) and NCM baseline tokenizers trained on XSum

    TimothDevA
    Verified signature
    16772ec