nielsr HF Staff commited on
Commit
5eabd27
·
verified ·
1 Parent(s): b87cf3a

Add community evaluation results for Terminal-Bench 2.0, SWE-bench Verified

Browse files

This PR adds community-provided evaluation results for the following benchmarks:

- **[Terminal-Bench 2.0](https://huggingface.co/datasets/harborframework/terminal-bench-2.0?eval_result=Multilingual-Multimodal-NLP/LoopCoder-V2&leaderboard_task_id=terminalbench_2)**
- **[SWE-bench Verified](https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified?eval_result=Multilingual-Multimodal-NLP/LoopCoder-V2&leaderboard_task_id=swe_bench_%25_resolved&leaderboard_max_params=500B)**

These results were extracted from the model card. This is based on the new [evaluation results feature](https://huggingface.co/docs/hub/eval-results).

*Note: This is an automated PR. Please review the evaluation results before merging.*

.eval_results/swe-bench_verified.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: SWE-bench/SWE-bench_Verified
3
+ task_id: swe_bench_%_resolved
4
+ value: 64.4
5
+ source:
6
+ url: https://huggingface.co/Multilingual-Multimodal-NLP/LoopCoder-V2
7
+ name: Model Card
.eval_results/terminal-bench-2.0.yaml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: harborframework/terminal-bench-2.0
3
+ task_id: terminalbench_2
4
+ value: 21.0
5
+ source:
6
+ url: https://huggingface.co/Multilingual-Multimodal-NLP/LoopCoder-V2
7
+ name: Model Card