OPEA
/

DeepSeek-R1-int4-AutoRound-awq-asym

4-bit precision

Model card Files Files and versions

cicdatopea commited on Apr 30, 2025

Commit

dc0ad00

·

verified ·

1 Parent(s): 56f8d03

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -61,7 +61,7 @@
     "scale_dtype": "torch.float16",
     "seqlen": 2048,
     "sym": false,
-    "to_quant_block_names": null,
     "version": "gemm",
     "zero_point": true
   },

     "scale_dtype": "torch.float16",
     "seqlen": 2048,
     "sym": false,
+    "block_name_to_quantize": null,
     "version": "gemm",
     "zero_point": true
   },