A newer version of the Gradio SDK is available: 6.19.0
metadata
title: RPC-Bench Leaderboard
emoji: 馃搫
colorFrom: blue
colorTo: gray
sdk: gradio
sdk_version: 5.0.0
python_version: 3.11
app_file: app.py
pinned: false
license: apache-2.0
RPC-Bench Leaderboard Space
馃寪 Project Page 路 馃摉 Paper 路 馃 Hugging Face 路 馃Л ModelScope
How to Submit
Fork the RPC-Bench dataset repository, create a branch, add one submission folder, and open a Pull Request:
submissions/
<organization>__<model>__<input_config>/
metadata.yaml
predictions.jsonl
generation_config.json # optional
artifacts/ # optional logs, prompts, run notes
Use URL-safe directory names. Replace spaces, slashes, and special characters with hyphens; keep input_config as TEXT or VISUAL.
metadata.yaml
model_name: "My Model"
organization: "My Org"
model_url: https://... # optional work link: paper, GitHub, model card, etc.
date: "2026-06-17" # model release date, not submission date
split: test
input_config: TEXT # TEXT or VISUAL
predictions.jsonl
Each line must be one JSON object:
{
"id": "paper-id",
"part_idx": 1,
"question": "question text",
"category": "category",
"gen_answer": "model answer"
}
part_idx is the question index in the current paper's qa_pairs list (1 for the first item). category must match the corresponding item in test.json.