Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Code Completion
/ComplexCodeEval-Python
/7
/QS
/line_counts_QS.csv
| Models, subset_0(15~19),subset_1(19~22),subset_2(22~26),subset_3(26~30),subset_4(31~36),subset_5(37~52),subset_6(52~119) | |
| StarCoder2-15b,5.86,12.21,14.55,13.38,16.76,18.72,24.60 | |
| CodeLlama-7b,19.97,20.29,23.92,23.60,18.08,26.68,23.01 | |
| CodeLlama-13b,27.76,28.53,21.55,28.99,22.39,23.19,22.38 | |
| CodeLlama-34b,32.75,27.38,28.39,23.35,26.75,23.81,25.40 | |
| DeepSeek-Coder-1.3b,30.19,28.45,30.58,26.93,24.66,28.16,26.65 | |
| DeepSeek-Coder-6.7b,12.67,15.55,18.74,22.84,23.59,26.13,26.03 | |
| DeepSeek-Coder-33b,28.33,31.97,27.91,29.17,28.04,29.71,25.69 | |