license: mit base_model: - deepseek-ai/DeepSeek-R1 base_model_relation: quantized
This model is a mixed-precision quantized DeepSeek-R1, with dense layer using FP8_BLOCK_SCALING, MoE layers uses INT4 weights and FP8 activation.
FP8_BLOCK_SCALING
