MMLU EVAL DGX SPARK

#2
by RGMC98 - opened

Qwen 3.5 4B MMLU on DGX SPARK

Groups Version Filter n-shot Metric Value Stderr
mmlu 2 none acc 0.7451 ± 0.0035
- humanities 2 none 0 acc 0.6618 ± 0.0066
- other 2 none 0 acc 0.7811 ± 0.0071
- social sciences 2 none 0 acc 0.8372 ± 0.0066
- stem 2 none 0 acc 0.7441 ± 0.0075

Sign up or log in to comment