update pad_token?
#1
by gatorand - opened
This comment has been hidden
It has quantized from the latest version available at https://huggingface.co/CohereForAI/aya-expanse-8b
So whatever they have in their tokenizer this should quantized with that.
Are you experiencing issues?
Tested it works fine for me
This comment has been hidden
gatorand changed discussion status to closed