ShuhanXue commited on
Commit
27317ce
·
verified ·
1 Parent(s): d95e30c

Add SLE v1 published evaluation results

Browse files

Add five published SLE v1 metrics (0–100) for MiniMax-M3. This submission is for M3, not M3.1-Flash.

Source: https://sciences-last-exam.org/leaderboard
Benchmark: https://huggingface.co/datasets/Gen-Verse/Science-Last-Exam
Definitions are pinned to dataset revision 022231bb779ed2b827c561b38b0902d0ea28c667. The composite equally weights four capability metrics over the 90-task scope; End-to-End Science and Hypothesis Discovery are excluded. Values retain the 1 November 2026 published chart-label precision.

Harness: Claude Code; reported effort: high. API endpoint measurements, not local or quantized weight evaluation. No verified badge is claimed. The benchmark is in private preview and native Benchmark activation is pending.

Files changed (1) hide show
  1. .eval_results/sle-v1-20261101.yaml +50 -0
.eval_results/sle-v1-20261101.yaml ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: Gen-Verse/Science-Last-Exam
3
+ task_id: composite-score
4
+ revision: 022231bb779ed2b827c561b38b0902d0ea28c667
5
+ value: 33.0
6
+ source:
7
+ url: https://sciences-last-exam.org/leaderboard
8
+ name: SLE published leaderboard (1 Nov 2026)
9
+ notes: Claude Code; high reasoning; API endpoint evaluation; published snapshot
10
+ 2026-11-01. Not a local-weight run.
11
+ - dataset:
12
+ id: Gen-Verse/Science-Last-Exam
13
+ task_id: protocol-planning-mean-score
14
+ revision: 022231bb779ed2b827c561b38b0902d0ea28c667
15
+ value: 43.0
16
+ source:
17
+ url: https://sciences-last-exam.org/leaderboard
18
+ name: SLE published leaderboard (1 Nov 2026)
19
+ notes: Claude Code; high reasoning; API endpoint evaluation; published snapshot
20
+ 2026-11-01. Not a local-weight run.
21
+ - dataset:
22
+ id: Gen-Verse/Science-Last-Exam
23
+ task_id: experiment-observation-pass-rate
24
+ revision: 022231bb779ed2b827c561b38b0902d0ea28c667
25
+ value: 38.0
26
+ source:
27
+ url: https://sciences-last-exam.org/leaderboard
28
+ name: SLE published leaderboard (1 Nov 2026)
29
+ notes: Claude Code; high reasoning; API endpoint evaluation; published snapshot
30
+ 2026-11-01. Not a local-weight run.
31
+ - dataset:
32
+ id: Gen-Verse/Science-Last-Exam
33
+ task_id: scientific-computing-full-credit-rate
34
+ revision: 022231bb779ed2b827c561b38b0902d0ea28c667
35
+ value: 22.0
36
+ source:
37
+ url: https://sciences-last-exam.org/leaderboard
38
+ name: SLE published leaderboard (1 Nov 2026)
39
+ notes: Claude Code; high reasoning; API endpoint evaluation; published snapshot
40
+ 2026-11-01. Not a local-weight run.
41
+ - dataset:
42
+ id: Gen-Verse/Science-Last-Exam
43
+ task_id: scientific-software-operation-full-credit-rate
44
+ revision: 022231bb779ed2b827c561b38b0902d0ea28c667
45
+ value: 29.0
46
+ source:
47
+ url: https://sciences-last-exam.org/leaderboard
48
+ name: SLE published leaderboard (1 Nov 2026)
49
+ notes: Claude Code; high reasoning; API endpoint evaluation; published snapshot
50
+ 2026-11-01. Not a local-weight run.