SGLang and MTP

#2
by Michalea - opened

Hello, I would like to ask you if you tested your model in SGLang. Especially MTP, as in vLLM on sm120 (rtx 6000 pro) it looks like buggy stuff

no, I didn't, but it was testing SM120, rtx pro 6000 BW on vllm

Sign up or log in to comment