QuantTrio
/

DeepSeek-V3.1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (1)

Is tool call available

#3 opened 5 months ago by

[2025-08-27] Please re-install dependencies according to the README with vllm 0.9.2, transformers 4.53.0, and the two patch files

#2 opened 6 months ago by

I could not run it, please check my steps

#1 opened 6 months ago by