RedHatAI
/

granite-3.1-8b-base-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions

robgreenberg3 commited on Sep 18, 2025

Commit

27dc16b

·

verified ·

1 Parent(s): feb0b74

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -38,6 +38,7 @@ license_link: https://www.apache.org/licenses/LICENSE-2.0
   - **Activation quantization:** BF16
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
 - **Model Developers:** Neural Magic (Red Hat)
 Quantized version of [ibm-granite/granite-3.1-8b-base](https://huggingface.co/ibm-granite/granite-3.1-8b-base).

   - **Activation quantization:** BF16
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
+- **Validated on:** RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5
 - **Model Developers:** Neural Magic (Red Hat)
 Quantized version of [ibm-granite/granite-3.1-8b-base](https://huggingface.co/ibm-granite/granite-3.1-8b-base).