j-llm
/

j48-tokenizer-v2

Model card Files Files and versions

j48-tokenizer-v2 / tokenizer.model

Commit History

Oct 3 25 days ago

12:02
Add j48-tokenizer-v2 (SentencePiece Unigram, vocab 48k)

eightman999

Verified signature
ed70cd3