Sinensis
/

L3.3-Nevoria-R1-70b-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Sinensis commited on Jun 24, 2025

Commit

c0ef338

·

verified ·

1 Parent(s): c0f2924

Update README.md

Files changed (1) hide show

README.md +6 -8

README.md CHANGED Viewed

@@ -10,11 +10,9 @@ tags:
 ## AWQ quantization of [Steelskull/L3.3-Nevoria-R1-70b](https://huggingface.co/Steelskull/L3.3-Nevoria-R1-70b)
-  "quantization_config": {
-    "bits": 4,
-    "group_size": 128,
-    "modules_to_not_convert": null,
-    "quant_method": "awq",
-    "version": "gemm",
-    "zero_point": true
-  }

 ## AWQ quantization of [Steelskull/L3.3-Nevoria-R1-70b](https://huggingface.co/Steelskull/L3.3-Nevoria-R1-70b)
+quantization_config:
+-bits: 4
+-group_size: 128
+-quant_method: awq
+-version: gemm
+-zero_point: true