wizardII commited on
Commit
1c47874
·
verified ·
1 Parent(s): cf3d5c0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +71 -3
README.md CHANGED
@@ -1,3 +1,71 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+
6
+ <table>
7
+ <thead>
8
+ <tr>
9
+ <th rowspan="2">Method</th>
10
+ <th colspan="2">LCB v5 (2024.08.01–2025.02.01)</th>
11
+ <th colspan="2">LCB v6 (2025.02.01–2025.05.01)</th>
12
+ <th rowspan="2">Avg.</th>
13
+ </tr>
14
+ <tr>
15
+ <th>avg@8</th>
16
+ <th>pass@8</th>
17
+ <th>avg@16</th>
18
+ <th>pass@16</th>
19
+ </tr>
20
+ </thead>
21
+ <tbody>
22
+ <tr>
23
+ <td>DeepSeek-R1-1.5B</td>
24
+ <td>16.7</td>
25
+ <td>29.0</td>
26
+ <td>17.2</td>
27
+ <td>34.4</td>
28
+ <td>17.0</td>
29
+ </tr>
30
+ <tr>
31
+ <td>DAPO</td>
32
+ <td>26.0</td>
33
+ <td>40.5</td>
34
+ <td>27.6</td>
35
+ <td>43.5</td>
36
+ <td>26.8</td>
37
+ </tr>
38
+ <tr>
39
+ <td>DeepCoder-1.5B</td>
40
+ <td>23.3</td>
41
+ <td>39.1</td>
42
+ <td>22.6</td>
43
+ <td>42.0</td>
44
+ <td>23.0</td>
45
+ </tr>
46
+ <tr>
47
+ <td>Nemotron-1.5B</td>
48
+ <td>26.1</td>
49
+ <td>35.5</td>
50
+ <td>29.5</td>
51
+ <td>42.8</td>
52
+ <td>27.8</td>
53
+ </tr>
54
+ <tr>
55
+ <td><strong>Archer-Code-1.5B</strong></td>
56
+ <td><strong>29.4</strong></td>
57
+ <td><strong>43.7</strong></td>
58
+ <td><strong>30.2</strong></td>
59
+ <td><strong>45.8</strong></td>
60
+ <td><strong>29.8</strong></td>
61
+ </tr>
62
+ <tr>
63
+ <td><strong>Archer2.0-Code-1.5B</strong></td>
64
+ <td><strong>31.5</strong></td>
65
+ <td><strong>47.0</strong></td>
66
+ <td><strong>*</strong></td>
67
+ <td><strong>*</strong></td>
68
+ <td><strong>*</strong></td>
69
+ </tr>
70
+ </tbody>
71
+ </table>