difference definition of eos token id in config.json and tokenizer_config.json
#7
by
ThreeGold116
- opened
eos token id in config.json: 2
eos token id in tokenizer_config.json: 0
Thank you for your reminder! I just fixed this problem.