Spaces:
Sleeping
Sleeping
Multi-view-leaderboard
/
dataset
/Code Completion
/ComplexCodeEval-Python
/6
/EI
/line_counts_EI.csv
| Models, subset_0(15~32),subset_1(33~46),subset_2(51~65),subset_4(88~99),subset_5(119~119) | |
| StarCoder2-15b,11.99,18.13,24.65,0.00,19.01,26.43 | |
| CodeLlama-7b,21.56,23.15,22.55,0.00,27.13,29.60 | |
| CodeLlama-13b,26.43,24.27,21.98,0.00,7.97,24.55 | |
| CodeLlama-34b,27.82,25.18,26.97,0.00,13.03,26.16 | |
| DeepSeek-Coder-1.3b,28.87,25.73,27.73,0.00,21.84,28.11 | |
| DeepSeek-Coder-6.7b,18.25,24.37,27.30,0.00,24.43,21.98 | |
| DeepSeek-Coder-33b,29.82,27.29,27.37,0.00,18.86,24.24 | |