Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Code Completion
/ComplexCodeEval-Python
/7
/EI
/line_counts_EI.csv
| Models, subset_0(15~29),subset_1(30~42),subset_2(45~59),subset_3(65~65),subset_4(88~88),subset_5(99~99),subset_6(119~119) | |
| StarCoder2-15b,11.27,16.72,23.98,21.61,16.29,21.74,26.43 | |
| CodeLlama-7b,22.01,20.27,24.45,28.58,30.05,24.21,29.60 | |
| CodeLlama-13b,26.88,24.18,21.94,30.35,11.42,4.53,24.55 | |
| CodeLlama-34b,28.04,25.03,27.50,31.58,20.14,5.93,26.16 | |
| DeepSeek-Coder-1.3b,29.51,24.33,28.69,39.60,27.00,16.68,28.11 | |
| DeepSeek-Coder-6.7b,17.12,24.06,27.13,23.55,26.60,22.25,21.98 | |
| DeepSeek-Coder-33b,29.60,27.90,28.63,29.96,29.59,8.12,24.24 | |