openeurollm
/

tokenizer-262k

european-languages

Model card Files Files and versions

Commit History

Add model card with description, usage, and evaluation results

74b8574
verified

timpal0l commited on 1 day ago

Upload 262k vocab SentencePiece BPE tokenizer (trained on 175GB)

f1d2f3d
verified

timpal0l commited on 1 day ago

initial commit

e392cee
verified

timpal0l commited on 1 day ago