Update tokenizer_config.json
#3
by itazap HF Staff - opened
update tokenizer_class (v4 and v5 compatible) as this isn't a Robert tokenizer !
Thanks for the pull request, I wasn't aware that Camembertv2 tokenizer was broken. I double checked and it is now fixed
wissamantoun changed pull request status to merged