Update tokenization_chatglm.py
#7
by gameofdimension - opened
fix "piece id is out of range"
I also encountered this problem, but it had no effect after modifying it like this
We have been paying attention to this problem for a long time. Although we suspect that it may be caused by the user did not input in the correct format, we still added this line of code . Minimize the occurrence of accidents.
thank you for your suggestion
ZHANGYUXUAN-zR changed pull request status to closed
按照最新的配置文件，仍然出现这个错误，请问一下是什么原因呢？