j72-tokenizer-v2 / tokenizer.model

Commit History

24 days ago

  1. Add j72-tokenizer-v2 (SentencePiece Unigram, vocab 72k)

    Verified signature
    fe724c3