RedHatAI
/

granite-3.1-2b-base-quantized.w8a8

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

nm-research commited on Jan 30, 2025

Commit

b89cdac

·

verified ·

1 Parent(s): 1541725

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -326,7 +326,7 @@ guidellm --model neuralmagic/granite-3.1-2b-base-quantized.w8a8 --target "http:/
     <td>4.7</td>
   </tr>
   <tr>
-    <td>granite-3.1-2b-base-quantized.w4a16</td>
     <td>1.94</td>
     <td>5.4</td>
     <td>0.7</td>
@@ -360,7 +360,7 @@ guidellm --model neuralmagic/granite-3.1-2b-base-quantized.w8a8 --target "http:/
     <td>4.5</td>
   </tr>
   <tr>
-    <td>granite-3.1-2b-base-quantized.w4a16</td>
     <td>1.87</td>
     <td>5.1</td>
     <td>0.7</td>
@@ -417,7 +417,7 @@ guidellm --model neuralmagic/granite-3.1-2b-base-quantized.w8a8 --target "http:/
     <td>1.4</td>
   </tr>
   <tr>
-    <td>granite-3.1-2b-base-quantized.w4a16</td>
     <td>0.98</td>
     <td>2.8</td>
     <td>10.0</td>
@@ -451,7 +451,7 @@ guidellm --model neuralmagic/granite-3.1-2b-base-quantized.w8a8 --target "http:/
     <td>1.7</td>
   </tr>
   <tr>
-    <td>granite-3.1-2b-base-quantized.w4a16</td>
     <td>0.95</td>
     <td>3.7</td>
     <td>11.4</td>

     <td>4.7</td>
   </tr>
   <tr>
+    <td>granite-3.1-2b-base-quantized.w8a8</td>
     <td>1.94</td>
     <td>5.4</td>
     <td>0.7</td>
     <td>4.5</td>
   </tr>
   <tr>
+    <td>granite-3.1-2b-base-quantized.w8a8</td>
     <td>1.87</td>
     <td>5.1</td>
     <td>0.7</td>
     <td>1.4</td>
   </tr>
   <tr>
+    <td>granite-3.1-2b-base-quantized.w8a8</td>
     <td>0.98</td>
     <td>2.8</td>
     <td>10.0</td>
     <td>1.7</td>
   </tr>
   <tr>
+    <td>granite-3.1-2b-base-quantized.w8a8</td>
     <td>0.95</td>
     <td>3.7</td>
     <td>11.4</td>