RedHatAI
/

gemma-3-4b-it-FP8-dynamic

text-generation-inference

compressed-tensors

Model card Files Files and versions

nm-research commited on Jun 6, 2025

Commit

82debe9

·

verified ·

1 Parent(s): 10c59be

Update README.md

Files changed (1) hide show

README.md +9 -9

README.md CHANGED Viewed

@@ -192,21 +192,21 @@ lm_eval \
     <tr>
       <td rowspan="3"><b>Vision Evals</b></td>
       <td>MMMU (val)</td>
-      <td>%</td>
-      <td>%</td>
-      <td>%</td>
     </tr>
     <tr>
       <td>ChartQA</td>
-      <td>%</td>
-      <td>%</td>
-      <td>%</td>
     </tr>
     <tr>
       <td><b>Average Score</b></td>
-      <td><b>%</b></td>
-      <td><b>%</b></td>
-      <td><b>%</b></td>
     </tr>
   </tbody>
 </table>

     <tr>
       <td rowspan="3"><b>Vision Evals</b></td>
       <td>MMMU (val)</td>
+      <td>39.89%/td>
+      <td>38.33%</td>
+      <td>96.09%</td>
     </tr>
     <tr>
       <td>ChartQA</td>
+      <td>50.76%</td>
+      <td>51.60%</td>
+      <td>101.65%</td>
     </tr>
     <tr>
       <td><b>Average Score</b></td>
+      <td><b>45.33%</b></td>
+      <td><b>44.97%</b></td>
+      <td><b>98.87%</b></td>
     </tr>
   </tbody>
 </table>