Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Code Completion
/ComplexCodeEval-Python
/8
/EI
/line_counts_EI.csv
| Models, subset_0(15~27),subset_1(28~40),subset_2(42~53),subset_3(55~65),subset_5(88~88),subset_6(99~99),subset_7(119~119) | |
| StarCoder2-15b,11.04,15.97,22.17,25.36,0.00,16.29,21.74,26.43 | |
| CodeLlama-7b,21.14,21.72,29.40,18.05,0.00,30.05,24.21,29.60 | |
| CodeLlama-13b,26.32,25.54,20.53,25.90,0.00,11.42,4.53,24.55 | |
| CodeLlama-34b,28.86,24.31,28.19,26.95,0.00,20.14,5.93,26.16 | |
| DeepSeek-Coder-1.3b,29.68,25.03,29.34,28.96,0.00,27.00,16.68,28.11 | |
| DeepSeek-Coder-6.7b,16.31,24.11,26.04,27.01,0.00,26.60,22.25,21.98 | |
| DeepSeek-Coder-33b,28.65,29.59,30.40,26.47,0.00,29.59,8.12,24.24 | |