Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Code Completion
/ComplexCodeEval-Python
/6
/QS
/line_counts_QS.csv
| Models, subset_0(15~19),subset_1(19~23),subset_2(23~28),subset_3(29~34),subset_4(36~46),subset_5(51~119) | |
| StarCoder2-15b,6.74,12.57,14.25,15.07,18.34,23.97 | |
| CodeLlama-7b,23.54,18.95,21.99,21.29,23.86,23.71 | |
| CodeLlama-13b,26.77,28.98,24.48,23.58,25.85,20.16 | |
| CodeLlama-34b,32.08,28.49,24.67,26.23,24.60,24.92 | |
| DeepSeek-Coder-1.3b,30.43,27.85,31.18,25.61,25.68,26.91 | |
| DeepSeek-Coder-6.7b,13.04,16.32,20.08,23.79,25.02,26.51 | |
| DeepSeek-Coder-33b,29.37,30.82,27.90,30.56,27.54,25.93 | |