Anyone already tried it with vllm serve command? If so could someone please provide the exact vllm version and the parameters needed to load the model?
· Sign up or log in to comment
