Add eval results
#5
by merve HF Staff - opened
YAML Metadata Error:Invalid content in Eval Result file .eval_results/hle.yaml
Check out the documentation for more information.
Show details
Task ID "hle" does not match any task in dataset "cais/hle". Available: none
YAML Metadata Error:Invalid content in Eval Result file .eval_results/hle_with_tools.yaml
Check out the documentation for more information.
Show details
Task ID "hle" does not match any task in dataset "cais/hle". Available: none
YAML Metadata Error:Invalid content in Eval Result file .eval_results/mmlu_pro.yaml
Check out the documentation for more information.
Show details
Task ID "mmlu_pro" does not match any task in dataset "TIGER-Lab/MMLU-Pro". Available: none
.eval_results/gpqa_diamond.yaml
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: Idavidrein/gpqa
|
| 3 |
+
task_id: diamond
|
| 4 |
+
value: 84.3
|
| 5 |
+
date: '2026-04-02'
|
| 6 |
+
source:
|
| 7 |
+
url: https://huggingface.co/google/gemma-4-31B-it
|
| 8 |
+
name: Model Card
|
| 9 |
+
user: merve
|
.eval_results/hle.yaml
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: cais/hle
|
| 3 |
+
task_id: hle
|
| 4 |
+
value: 19.5
|
| 5 |
+
date: '2026-04-02'
|
| 6 |
+
source:
|
| 7 |
+
url: https://huggingface.co/google/gemma-4-31B-it
|
| 8 |
+
name: Model Card
|
| 9 |
+
user: merve
|
.eval_results/hle_with_tools.yaml
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: cais/hle
|
| 3 |
+
task_id: hle
|
| 4 |
+
value: 26.5
|
| 5 |
+
date: '2026-04-02'
|
| 6 |
+
source:
|
| 7 |
+
url: https://huggingface.co/google/gemma-4-31B-it
|
| 8 |
+
name: Model Card
|
| 9 |
+
user: merve
|
| 10 |
+
notes: "With search"
|
.eval_results/mmlu_pro.yaml
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: TIGER-Lab/MMLU-Pro
|
| 3 |
+
task_id: mmlu_pro
|
| 4 |
+
value: 85.2
|
| 5 |
+
date: '2026-04-02'
|
| 6 |
+
source:
|
| 7 |
+
url: https://huggingface.co/google/gemma-4-31B-it
|
| 8 |
+
name: Model Card
|
| 9 |
+
user: merve
|