vllm不支持Qwen2ForRewardModel

by vinf - opened Sep 20, 2024

Model architectures ['Qwen2ForRewardModel'] are not supported for now, how to solve it, help help help

Qwen org Sep 23, 2024

Sorry, but vllm does not support this at the moment. We hope it will be supported in the future.

Zhenru changed discussion status to closed Sep 23, 2024

Sorry, but vllm does not support this at the moment. We hope it will be supported in the future.

Is there any other way to deploy this model besides using transformers?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment