Upd tokenizer bos_token, eos_token, pad_token

by sirorezka - opened 12 days ago

←

This is the SFT model? I think that correct tokens should be this ones.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

· Sign up or log in to comment