openeurollm
/

tokenizer-262k

european-languages

Model card Files Files and versions

tokenizer-262k / tokenizer_config.json

Commit History

Upload 262k vocab SentencePiece BPE tokenizer (trained on 175GB)

f1d2f3d
verified

timpal0l commited on 2 days ago