SaylorTwift HF Staff commited on
Commit
ae51853
·
verified ·
1 Parent(s): b4734de

Add Terminal-Bench 2.1 evaluation results

Browse files

# Add Evaluation Results for zai-org/GLM-5.2

## Summary

This PR adds two Terminal-Bench 2.1 evaluation results extracted from the model card
benchmark table for `zai-org/GLM-5.2` to the `.eval_results/` directory, following the
[Hugging Face Hub evaluation-results specification](https://huggingface.co/docs/hub/eval-results).
The model card reports Terminal-Bench 2.1 under two different harnesses, so both are
recorded against the same `terminalbench_2_1` task, distinguished via `notes`.

## Benchmarks Added

- [Terminal Bench 2.1](https://huggingface.co/datasets/harborframework/terminal-bench-2.1?eval_result=zai-org/GLM-5.2&leaderboard_task_id=terminalbench_2_1) — 81.0 (Terminus-2 harness)
- [Terminal Bench 2.1](https://huggingface.co/datasets/harborframework/terminal-bench-2.1?eval_result=zai-org/GLM-5.2&leaderboard_task_id=terminalbench_2_1) — 82.7 (Best reported harness: Claude Code 2.1.167)

## Benchmarks Skipped (Not Registered on Hub)

Not applicable — only Terminal-Bench 2.1 was requested for this PR.

## Source

- Model card: https://huggingface.co/zai-org/GLM-5.2
- Paper: https://arxiv.org/abs/2602.15763

## Files Added

- `.eval_results/terminal-bench-2.1.yaml`

## Verification

This result was extracted from the model card's published benchmark table (row
"Terminal Bench 2.1 (Terminus-2)"), not from independently re-run/verified eval logs.

.eval_results/terminal-bench-2.1.yaml ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: harborframework/terminal-bench-2.1
3
+ task_id: terminalbench_2_1
4
+ value: 81.0
5
+ date: "2026-07-02"
6
+ source:
7
+ url: https://huggingface.co/zai-org/GLM-5.2
8
+ name: Model Card
9
+ notes: "Terminus-2 harness (temperature=1.0, top_p=1.0, 256K context, max_episodes=500)."
10
+ - dataset:
11
+ id: harborframework/terminal-bench-2.1
12
+ task_id: terminalbench_2_1
13
+ value: 82.7
14
+ date: "2026-07-02"
15
+ source:
16
+ url: https://huggingface.co/zai-org/GLM-5.2
17
+ name: Model Card
18
+ notes: "Best reported harness: Claude Code 2.1.167 (temperature=1.0, top_p=0.95, max_new_tokens=131072, no wall-clock limit, averaged over 5 runs)."