openeurollm
/

tokenizer-262k

european-languages

Model card Files Files and versions

tokenizer-262k / tokenizer.model

Commit History

Upload 262k vocab SentencePiece BPE tokenizer (trained on 175GB)

f1d2f3d
verified

timpal0l commited on 1 day ago