Sinensis
/

L3.3-Nevoria-R1-70b-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Sinensis commited on Jun 24, 2025

Commit

754d2b9

·

verified ·

1 Parent(s): c0ef338

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -10,9 +10,9 @@ tags:
 ## AWQ quantization of [Steelskull/L3.3-Nevoria-R1-70b](https://huggingface.co/Steelskull/L3.3-Nevoria-R1-70b)
-quantization_config:
--bits: 4
--group_size: 128
--quant_method: awq
--version: gemm
--zero_point: true

 ## AWQ quantization of [Steelskull/L3.3-Nevoria-R1-70b](https://huggingface.co/Steelskull/L3.3-Nevoria-R1-70b)
+quantization_config:
+bits: 4
+group_size: 128
+quant_method: awq
+version: gemm
+zero_point: true