Updated ids for bos_id, eos_id

by sirorezka - opened 12 days ago

←

bos_token = "<|im_start|>" bos_id = 1
eos_token = "<|im_end|>" eos_id=2

Also would be good to know pad_token_id. I think it must be defined in this file as well.

ridger changed pull request status to merged 5 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment