OPEA
/

DeepSeek-R1-int4-gptq-sym-inc

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened about 1 year ago by

sglang inference issue

#1 opened about 1 year ago by