ISTA-DASLab
/

DeepSeek-R1-GPTQ-4b-128g-experts

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Resources

View closed (0)

We look forward to a perfect AWQ or GPTQ quantized version.

#2 opened 10 months ago by

How to Only compress non-shared experts within transformer blocks?

#1 opened 11 months ago by