does the tokenizer need to be updated for this model?
#5
by electroglyph - opened
TemplateProcessing section was added to tokenizer.json for Qwen3-Embedding-0.6B, is a similar fix needed here?
Did you already test it?
TemplateProcessing section was added to tokenizer.json for Qwen3-Embedding-0.6B, is a similar fix needed here?
Did you already test it?