can use vllm deploy this model？
#8
by tianyer - opened
which vllm version can deploy this model? thanks.
tianyer changed discussion title from can use vllm deplot this model？ to can use vllm deploy this model？
I deploy it with vllm-v0.9.1，and it works
Here is the startup command