Add LEXam-hard evaluation result

#29
by joelniklaus HF Staff - opened
Files changed (1) hide show
  1. .eval_results/lexam-hard.yaml +12 -0
.eval_results/lexam-hard.yaml ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: joelniklaus/LEXam-hard
3
+ task_id: lexam_hard
4
+ revision: 1bd50ee3ac80286fed27e5b89f03f4d8b4494244
5
+ value: 37.07
6
+ date: '2026-06-20'
7
+ source:
8
+ url: https://huggingface.co/buckets/joelniklaus/SwissLegalEvals
9
+ name: SwissLegalEvals per-sample details (lighteval)
10
+ user: joelniklaus
11
+ notes: lighteval, LEXam paper prompts, one response per question, no tools; DeepSeek-R1-0528 judge;
12
+ mean of the German and English means over the 518 questions, 0-100