Fix generation when `repetition_penalty` is activated
#57
by YenChunChen - opened
In input_ids negative integers indicates image tokens. However, repetition_penalty in model.generate requires all input_ids in the proper range (0 - vocab_size, see this line). This PR makes generation with repetition_penalty run correctly.
For now, the in-place modification of input_ids does not affect the finetuning workflows in Phi-3Cookbook. A warning is added for user awareness though.
YenChunChen changed pull request status to open
leoxiaobin changed pull request status to merged