Hello, I would like to ask you if you tested your model in SGLang. Especially MTP, as in vLLM on sm120 (rtx 6000 pro) it looks like buggy stuff
no, I didn't, but it was testing SM120, rtx pro 6000 BW on vllm
Β· Sign up or log in to comment