Does the model supported Thai language?
#4
by new5558 - opened
Thank you for the decision to open source this model. I am Thai speaker and there are not many models that support our languages. Although It is stated on the model card that Thai is one of the supported languages, I cannot find any trace of Thai character inside tokenizer.json.
Is there anything I missed to run inference in Thai?
Did you happen to find any answer ? I am looking same for some other language
new5558 changed discussion status to closed
Sadly, I think multilingual mentioned in the model card may be a mistake since that is only alphabet character in tokenizer.json file