File size: 421 Bytes
2dddcdf |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
base_model: Steelskull/L3.3-Electra-R1-70b
library_name: transformers
quantized_by: Sinensis
pipeline_tag: text-generation
---
## AWQ quantization of [Steelskull/L3.3-Electra-R1-70b](https://huggingface.co/Steelskull/L3.3-Electra-R1-70b)
"quantization_config": {
"bits": 4,
"group_size": 128,
"modules_to_not_convert": null,
"quant_method": "awq",
"version": "gemm",
"zero_point": true
} |