Bengali-t5 / tokenizer.json

Commit History

Move tokenizer to root
80ee060

ibraheemmoosa commited on

Add a T5 rokenizer trained on mc4['bn'] and the configuration of t5-small.
829c8ab

ibraheemmoosa commited on