ISTA-DASLab

/

DeepSeek-R1-0528-GPTQ-4b-128g-experts

like 5

Follow

IST Austria Distributed Algorithms and Systems Lab 126

@cjld we actually do have it
See https://huggingface.co/ISTA-DASLab/DeepSeek-V3-0324-GPTQ-4b-128g-experts

Currently, without evaluation results, as they are quite expensive to run.

Thanks

@cjld fixed the model, there was an issue during model conversion in the original version.

Now, hopefully, should work fine:
https://huggingface.co/ISTA-DASLab/DeepSeek-V3-0324-GPTQ-4b-128g-experts