Hugging Face's logo

Spaces:
MERA-evaluation
/
MERA_Reason
Running

App Files Community
MERA_Reason / README.md
mathamateur
Update board
a1e9cea
preview code
|
Raw
History Blame Contribute Delete
1.24 kB

A newer version of the Gradio SDK is available: 6.24.0

Upgrade
metadata 
title: MERA Reason
emoji: 🥇
colorFrom: green
colorTo: indigo
sdk: gradio
app_file: app.py
pinned: true
license: other
short_description: Оценка способностей к рассуждению на русском языке
sdk_version: 5.43.1
tags:
  - leaderboard

MERA Reason Leaderboard

Zip-only leaderboard for ruAIME, T-math, Luzitania, MMReD (open-reasoning track).

Submission flow

  1. Upload a MERA-style zip on the Submit tab (ruaime.json, t_math.json, luzitania.json, mmred.json, logs_public/).
  2. Metrics are extracted from results_*.json inside logs_public.
  3. Aggregated scores are saved to the results dataset repo and reloaded on every page visit.
  4. Tables update immediately — no evaluation queue.

Metrics

Benchmark Main leaderboard metric
ruAIME Exact match
T-math Exact match
Luzitania Exact match
MMReD em.dc_aggregate

The MMReD dataset tab also shows group-level em.dc_aggregate and per-subtask exact_match.

Configuration

  • Tasks and column names: src/about.py
  • Zip parsing: src/submission/process_zip.py
  • Local storage: src/leaderboard/store.py, directory results/