Zhangyc02's picture
Adapt tokenization_interns1.py to transformers>=5.0.0
65efc11 verified