metadata
library_name: openvino
base_model_relation: quantized
quantized_by: HyX3
license: apache-2.0
tags:
- openvino
- int4
- text-generation
- magnum
- quantized
base_model: anthracite-org/magnum-v4-12b
Magnum 12B OpenVINO INT4
This is an OpenVINO INT4 quantized version of Magnum 12B.
Optimization:
- Precision: INT4 (Asymmetric)
- Framework: OpenVINO
- Goal: CPU-based inference acceleration without significant loss in quality.