RedHatAI
/

DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

nm-research commited on Feb 12, 2025

Commit

03be53d

·

verified ·

1 Parent(s): e9fb221

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -158,7 +158,7 @@ lm_eval \
       <th>Category</th>
       <th>Metric</th>
       <th>deepseek-ai/DeepSeek-R1-Distill-Qwen-14B</th>
-      <th>neuralmagic/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic</th>
       <th>Recovery</th>
     </tr>
   </thead>

       <th>Category</th>
       <th>Metric</th>
       <th>deepseek-ai/DeepSeek-R1-Distill-Qwen-14B</th>
+      <th>neuralmagic/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16</th>
       <th>Recovery</th>
     </tr>
   </thead>