Qwen

/

Qwen3-VL-Reranker-8B

like 146

Follow

Qwen 85k

Today there was a new template added:
additional_chat_templates/reranker.jinja

Before, this model needed a custom template. Now one has been added, but it breaks existing templates. You get an error like:
TypeError: expected str, bytes or os.PathLike object, not NoneType

This is true with transformers 4.57.1.

A workaround is to run sglang with this option:
--revision a718125bb61a08e0248962cb02a58deb53ca2d27