T0KII
/

MASRISET-tokenizer

Model card Files Files and versions

MASRISET-tokenizer / tokenizer.json

T0KII's picture

MASRISET expanded tokenizer (+40,274 Franco/EN tokens)

94d1f12 verified about 1 month ago

History Contribute Delete

10.1 MB

File too large to display, you can check the raw version instead.