Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Test Generation
/ComplexCodeEval-Python
/8
/QS
/line_counts_QS.csv
| Models, subset_0(15~23),subset_1(24~29),subset_2(31~40),subset_3(40~49),subset_4(50~58),subset_5(58~76),subset_6(79~133),subset_7(133~749) | |
| StarCoder2-15b,28.20,28.73,22.45,22.71,24.44,18.34,25.32,24.47 | |
| CodeLlama-7b,21.38,25.55,22.38,31.90,29.45,24.23,30.11,27.22 | |
| CodeLlama-13b,30.03,28.32,28.37,24.80,27.65,25.20,22.43,26.98 | |
| CodeLlama-34b,30.29,30.68,26.60,21.67,25.88,25.78,27.94,27.66 | |
| DeepSeek-Coder-1.3b,22.21,25.49,24.23,28.70,27.72,22.97,26.75,27.07 | |
| DeepSeek-Coder-6.7b,25.00,24.71,23.57,27.31,24.29,24.95,22.78,23.69 | |
| DeepSeek-Coder-33b,30.28,29.29,29.88,25.43,32.16,26.34,27.36,31.42 | |