Agent reliability: real data & tools
Real agent work data from our production multi-agent fleet, plus the benchmarks we test against. Like what helps you. github.com/tonydzi
- Viewer • Updated • 34.9k • 224
Verbatim Citation Gate
🔎Catch fabricated RAG quotes in your browser, zero tokens
Note Try our deterministic citation checker in your browser. Code: https://github.com/tonydzi/verbatim-citation-gate . A matching quote is not proof that the claim is true.
TonyDzi/research-evidence-qa
Viewer • Updated • 8Note Eight authored research-reading questions, reference answers and rubrics from seven version-pinned primary papers. All evidence excerpts checked against fetched abstracts. No model score or benchmark pass claimed.
TonyDzi/agent-action-policy-eval
Viewer • Updated • 91Note 91 author-written action tasks, expected answers and measured per-case outputs of a pinned deterministic baseline. 100% must-ask routing and 50% over-refusal. Code, conditions and reproduction included; no SWE/GAIA score claimed.
nebius/SWE-rebench
Viewer • Updated • 27.9k • 61.1k • 79Note Reference benchmark. This collection item reports no agent run or score. Our separately measured 91-task baseline: https://huggingface.co/datasets/TonyDzi/agent-action-policy-eval
MiniMaxAI/OctoCodingBench
Viewer • Updated • 72 • 531 • 449Note Reference benchmark. This collection item reports no agent run or score. Our separately measured 91-task baseline: https://huggingface.co/datasets/TonyDzi/agent-action-policy-eval
GAIA Leaderboard
🦾634Submit your model's answers and view GAIA leaderboard
Note Agent leaderboard we track
pyannote/speaker-diarization-community-1
Automatic Speech Recognition • Updated • 5.11M • 3.93kNote Diarization in our voice pipeline
openai/whisper-large-v3
Automatic Speech Recognition • 2B • Updated • 3.54M • • 6.77kNote Speech-to-text in our voice pipeline
ReAct: Synergizing Reasoning and Acting in Language Models
Paper • 2210.03629 • Published • 38Note ReAct: background on interleaving reasoning and actions. Primary source for our research-reading tasks. This collection entry reports no reproduced model run or agent score.
The BrowserGym Ecosystem for Web Agent Research
Paper • 2412.05467 • Published • 24Note BrowserGym ecosystem: primary paper about comparable web-agent environments and AgentLab. Source for our research-reading tasks; no local installation or benchmark result is implied.