Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Code Completion
/ComplexCodeEval-Python
/8
/QS
/line_counts_QS.csv
| Models, subset_0(15~19),subset_1(19~21),subset_2(21~25),subset_3(25~29),subset_4(29~32),subset_5(33~40),subset_6(40~53),subset_7(53~119) | |
| StarCoder2-15b,6.02,12.03,13.75,13.39,15.02,17.43,21.09,24.05 | |
| CodeLlama-7b,19.65,22.02,22.97,23.25,19.75,22.83,25.01,22.41 | |
| CodeLlama-13b,28.21,27.29,23.98,28.59,23.83,25.83,20.16,21.08 | |
| CodeLlama-34b,33.18,27.91,27.81,23.48,26.60,26.29,24.26,24.63 | |
| DeepSeek-Coder-1.3b,30.71,26.75,32.57,28.26,25.76,24.59,28.14,26.12 | |
| DeepSeek-Coder-6.7b,12.23,15.09,19.06,21.23,24.16,25.20,24.93,25.99 | |
| DeepSeek-Coder-33b,28.77,30.44,29.60,29.78,30.55,28.22,26.44,25.31 | |