Which vllm version should be used?

by damirca - opened Feb 4

Feb 4

I have a general misunderstanding which vllm is used for intel's autoround models here? Is it llm-scaler? is it vanilla vllm? Which version?
Would it work with single b60?
Thank you!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment