SaulLu
/

bengali-tokenizer-v2

Model card Files Files and versions

bengali-tokenizer-v2 / tokenizer.json

Commit History

set lstrip to false

beaff1b

SaulLu commited on May 18, 2021

init

84e91ce

SaulLu commited on May 18, 2021