FlagRelease
/

DeepSeek-R1-FlagOS-Nvidia-BF16

Model card Files Files and versions

tianxiaobaai commited on Mar 11, 2025

Commit

56eba38

·

verified ·

1 Parent(s): ae1aa82

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -54,7 +54,9 @@ We provide dequantized model weights in bfloat16 to run DeepSeek-R1 on NVIDIA GP
 | GSM8K (EM)         | 95.75                 | 95.83                      |
 | MMLU (Acc.)        | 85.34                 | 85.56                      |
 | CEVAL              | 89.00                 | 89.60                      |
-| AIME 2024 (Pass@1) | 76.66                 | TBD                        |
 | MMLU-Pro (Acc.)    | TBD                   | TBD                        |

 | GSM8K (EM)         | 95.75                 | 95.83                      |
 | MMLU (Acc.)        | 85.34                 | 85.56                      |
 | CEVAL              | 89.00                 | 89.60                      |
+| AIME 2024 (Pass@1) | 76.67                 | 70.00                        |
+| GPQA-Diamond (Pass@1) | 70.20                | 71.21                        |
+| MATH-500 (Pass@1) | 93.20                 | 94.80                       |
 | MMLU-Pro (Acc.)    | TBD                   | TBD                        |