Models, subset_0(158~190),subset_1(190~217),subset_2(218~246),subset_3(249~275),subset_4(277~318),subset_5(321~391),subset_6(391~1002)
StarCoder2-15b,6.76,13.60,12.29,14.65,15.36,19.51,23.91
CodeLlama-7b,23.87,20.91,17.97,24.91,18.66,23.90,25.33
CodeLlama-13b,27.41,25.94,27.30,26.40,21.73,25.68,20.33
CodeLlama-34b,33.25,29.39,23.64,26.37,25.30,24.38,25.50
DeepSeek-Coder-1.3b,30.20,30.02,27.65,26.04,27.11,28.41,26.18
DeepSeek-Coder-6.7b,11.37,19.12,18.51,21.44,22.79,26.53,25.78
DeepSeek-Coder-33b,27.61,32.24,29.76,26.09,29.56,30.41,25.13