File size: 1,930 Bytes
4e4ebc6 67678da 4e4ebc6 9d8edae 3718ffe 4e4ebc6 67678da 4e4ebc6 2c6288c 4e4ebc6 2c6288c 4527eaf 2c6288c 4e4ebc6 2c6288c 1dd52d9 2c6288c 1dd52d9 4e4ebc6 2c6288c 1dd52d9 2c6288c 4e4ebc6 2c6288c 4e4ebc6 2c6288c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 |
---
title: TemporalBench Leaderboard
emoji: 🥇
colorFrom: green
colorTo: indigo
sdk: gradio
app_file: app.py
pinned: true
license: apache-2.0
short_description: Read-only TemporalBench leaderboard for offline results.
sdk_version: 5.49.1
tags:
- leaderboard
---
# TemporalBench Leaderboard
This Space is a read-only visualization and validation layer for **offline** TemporalBench results.
It does not execute agents, call LLM APIs, or accept API keys.
## Configuration
- Set the local results file path via `TEMPORALBENCH_RESULTS_PATH`.
Default is `data/results.json`.
- Submissions are stored in `data/submissions/` for manual review (override with `TEMPORALBENCH_SUBMISSIONS_PATH`).
- Update descriptive text in `src/about.py`.
## Results File Format
Results must be a JSON list or CSV table, where each record is one agent configuration.
Required fields per record:
```json
{
"model_name": "string",
"agent_name": "string",
"agent_type": "string",
"base_model": "string",
"T1_acc": 0.0,
"T2_acc": 0.0,
"T3_acc": 0.0,
"T4_acc": 0.0,
"T2_sMAPE": 0.0,
"T2_MAE": 0.0,
"T4_sMAPE": 0.0,
"T4_MAE": 0.0,
"FreshRetailNet_T2_sMAPE": 0.0,
"FreshRetailNet_T2_MAE": 0.0,
"MIMIC_T2_OW_sMAPE": 0.0,
"MIMIC_T2_OW_RMSSE": 0.0
}
```
Notes:
- `T2_sMAPE`, `T2_MAE`, `T4_sMAPE`, `T4_MAE` are optional (forecasting metrics).
- Dataset-level columns are optional and displayed if present.
- For MIMIC forecasting, only `OW_sMAPE` and `OW_RMSSE` are expected.
- Any additional numeric columns are treated as optional domain metrics and will be shown.
- Records must have a consistent schema and numeric metric values.
## Project Structure
- `app.py`: Gradio UI + leaderboard rendering
- `src/leaderboard/load_results.py`: Load + validate results
- `src/leaderboard/schema.py`: Identity/metric field definitions
- `src/about.py`: Text and descriptions
- `src/display/css_html_js.py`: Custom styling
|