Commit History

Today

  1. Gemini CLI: thought summaries filed as messages by Harbor's old converter, counted as reasoning (summary only)

    evalstate HF Staff
    Verified signature
    05c21f3
  2. Trace completeness: share of output tokens in the trace; why not (withheld by provider, not kept by harness, lost in conversion, summary only); counted/inferred basis; undercounted

    evalstate HF Staff
    Verified signature
    fe0df2c
  3. Output tokens as shares: tool calls, messages, reasoning shown, reasoning hidden

    evalstate HF Staff
    Verified signature
    00853bc

Yesterday

  1. Cost estimate: only a fit that reproduces recorded costs prices trials; unpriced wording; PR-aware row page

    evalstate HF Staff
    Verified signature
    8cecfac
  2. Our estimate (leads + fallback discounted), output/hidden reasoning bar, cost estimate, regrouped gaps, waffle flags, Harbor Hub trial links

    evalstate HF Staff
    Verified signature
    b8a3c5c
  3. Viewer: fold many argument-value fields per call (atif-scan 43ae555)

    evalstate HF Staff
    Verified signature
    77fbc9e
  4. Quieter design: leaderboard + row pages + compare; full trajectories for highlighted trials (atif-scan 90c8670 --viewer-split)

    evalstate HF Staff
    Verified signature
    5d9b93c
  5. Models served/fallback, reasoning and output-token accounting, drill-down to trials, tooltip fix

    evalstate HF Staff
    Verified signature
    8c073f5
  6. Data holes & accounting; leaderboard rows scored as listed (atif-scan v0.8.17-2-g4fbd8b8)

    evalstate HF Staff
    Verified signature
    2cbfd05
  7. TB2.1 annotated: 22 leaderboard rows, atif-scan v0.8.17 highlights and trajectories

    evalstate HF Staff
    Verified signature
    edc735f