T0KII
/

MASRISET-tokenizer

Model card Files Files and versions

MASRISET-tokenizer / tokenizer.json

Commit History

MASRISET expanded tokenizer (+40,274 Franco/EN tokens)

94d1f12
verified

T0KII commited on May 22

MASRISET expanded tokenizer (+0 Franco/EN tokens)

368904a
verified

T0KII commited on May 22