Can you support SGLang or vLLM?
#19
by Zihan-zzh - opened
In the recommended project to deploy this model only supports single batch reasoning and the performance is not too good, can the model be supported in mainstream reasoning frameworks like vLLM or SGLang?
same question