Intel
/

DeepSeek-V3.1-Terminus-int4-mixed-AutoRound

Text Generation

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

can we get this for the new Deepseek v3.2?

#2 opened 8 months ago by

Question will it work in vllm or sglang with rtx 6000 blackwells? cuda arch sm120

#1 opened 9 months ago by