Hugging Face's logo

DMindAI
/
DMind-2-4B

Safetensors
English
Chinese
qwen3
Model card Files
xet
Community
Yizk commited on
Commit
0cff423
·
verified ·
1 Parent(s): ec5d8bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -83,15 +83,15 @@ Safety alignment is another aspect we particularly emphasize. The Web3 investmen
83
  | Category | Benchmark (Metric) | DeepSeek-R1-0528-Qwen3-8B | gpt-oss-20b | Qwen3-32B | Qwen3-4B(Thinking) | DMind2-mini(4B) |
84
  | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
85
  | **General** | | | | | | |
86
- | | MMLU-Pro (EM) | 84.0 | 85.0 | - | - | 82.1 |
87
- | | GPQA-Diamond (Pass@1) | 71.5 | 81.0 | - | - | 64.2 |
88
- | | SimpleQA (Correct) | 30.1 | 27.8 | - | - | - |
89
  | **Math** | | | | | | |
90
- | | AIME 2024 (Pass@1) | 79.8 | 91.4 | 81.4 | - | 92.7 |
91
- | | AIME 2025 (Pass@1) | 70.0 | 87.5 | 72.9 | - | 81.6 |
92
  | | CNMO 2024 (Pass@1) | 78.8 | 86.9 | - | - | 82.4 |
93
  | **Tools** | | | | | | |
94
- | | BFCL_v3 | - | 37.0 | - | - | 70.2 |
95
  | **Web3** | | | | | | |
96
  | | DMind Benchmark | - | - | - | - | - |
97
 
 
83
  | Category | Benchmark (Metric) | DeepSeek-R1-0528-Qwen3-8B | gpt-oss-20b | Qwen3-32B | Qwen3-4B(Thinking) | DMind2-mini(4B) |
84
  | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
85
  | **General** | | | | | | |
86
+ | | MMLU-Pro (EM) | 84.0 | 85.3 | 65.54 | 70.4 | 82.1 |
87
+ | | GPQA-Diamond (Pass@1) | 71.5 | 71.5 | 68.4 | 55.9 | 64.2 |
88
+ | | SimpleQA (Correct) | 30.1 | 6.7 | 8 | 1.0 | - |
89
  | **Math** | | | | | | |
90
+ | | AIME 2024 (Pass@1) | 79.8 | 96 | 81.4 | - | 92.7 |
91
+ | | AIME 2025 (Pass@1) | 70.0 | 98.7 | 72.9 | 65.6 | 81.6 |
92
  | | CNMO 2024 (Pass@1) | 78.8 | 86.9 | - | - | 82.4 |
93
  | **Tools** | | | | | | |
94
+ | | BFCL_v3 | - | 37.0 | 70.3 | 65.9 | 70.2 |
95
  | **Web3** | | | | | | |
96
  | | DMind Benchmark | - | - | - | - | - |
97