File size: 1,180 Bytes
bdcde10
edc735f
 
 
 
bdcde10
 
edc735f
bdcde10
 
edc735f
 
 
 
 
 
 
 
2cbfd05
 
 
 
edc735f
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
title: Terminal-Bench 2.1, annotated
emoji: ๐Ÿ”Ž
colorFrom: yellow
colorTo: gray
sdk: static
pinned: false
short_description: The TB2.1 leaderboard, trial by trial, with atif-scan review
---

# Terminal-Bench 2.1, annotated

The public [Terminal-Bench 2.1](https://hub.harborframework.com/) main leaderboard, re-read trial by
trial with [atif-scan](https://github.com/evalstate/atif-scan). For every row:

- **Highlights** โ€” masked excerpts of where findings and benchmark-awareness stages happened;
- **Trajectories** โ€” atif-scan's static viewer of every finding-related step;
- a task ร— attempt strip, review leads beside the leaderboard's own reward-hack rate, and a
  checks ร— rows matrix linking straight to the excerpts;
- **data holes & accounting**: how much reasoning each row's traces hold (full, summary, hidden,
  unrecorded), compacted history, web results missing from the trace, unpaired tool results, and
  per-trial costs against the leaderboard's total.

Findings are review leads, not verdicts. Leaderboard scores, reward-hack rates and costs are the
leaderboard's own. Trace text is atif-scan's credential-masked export of public leaderboard trials.