Fix eos_token in tokenizer_config.json to use im_end for Instruct Model
#17
by luosuu - opened
eos_token for instruct model should be im_end instead of the original eos token in base model
eos_token for instruct model should be im_end instead of the original eos token in base model