MMLU EVAL DGX SPARK
#2
by
RGMC98 - opened
Qwen 3.5 4B MMLU on DGX SPARK
| Groups | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| mmlu | 2 | none | acc | 0.7451 | ± | 0.0035 | ||
| - humanities | 2 | none | 0 | acc | ↑ | 0.6618 | ± | 0.0066 |
| - other | 2 | none | 0 | acc | ↑ | 0.7811 | ± | 0.0071 |
| - social sciences | 2 | none | 0 | acc | ↑ | 0.8372 | ± | 0.0066 |
| - stem | 2 | none | 0 | acc | ↑ | 0.7441 | ± | 0.0075 |