bowiehsu Saoyu commited on
Commit
8a96218
·
1 Parent(s): 2e0ebe7

Update README.md (#3)

Browse files

- Update README.md (6366fbb3878044cef7d85ab679ed7680086745cd)


Co-authored-by: WuShaoyu <Saoyu@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +227 -4
README.md CHANGED
@@ -1,9 +1,232 @@
1
  ---
2
  license: apache-2.0
 
3
  ---
4
- Our D-CORE paper: arxiv.org/abs/2602.02160
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
 
6
  ### ACEBench
7
- | Model | bool | enum | number | list | object_short | object_deep | atom | single_turn_singal_function | single_turn_parallel_function | single_turn | multiple_turn_switch | multiple_turn_adjust | multiple_turn | similar_api | profile | normal_summary | incomplete | error | irrelevant | special_summary | agent_multi_turn | agent_multi_turn_process | agent_multi_step | agent_multi_step_process | agent_summary | Summary |
8
- |:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|:---|
9
- |**D-CORE-8B**| 0.9 | 0.98 | 0.98 | 0.98 | 0.36 | 0.76 | 0.827 | 0.85 | 0.7 | 0.775 | 0.64 | 0.6 | 0.62 | 0.78 | 0.82 | 0.779 | 0.58 | 0.82 | 0.96 | 0.787 | 0.433 | 0.668 | 0.75 | 0.808 | 0.592 | 0.752 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ pipeline_tag: text-generation
4
  ---
5
+
6
+ # D-CORE: Incentivizing Task Decomposition in Large Reasoning Models for Complex Tool Use
7
+
8
+ This repository contains the weights for **D-CORE** (**D**ecomposing tasks and **Co**mposing **Re**asoning processes), a two-stage training framework designed to enhance the task decomposition and reflective reasoning capabilities of Large Reasoning Models (LRMs) for complex tool use.
9
+
10
+ ## Introduction
11
+ Effective tool use and reasoning are essential capabilities for large reasoning models (LRMs) to address complex real-world problems. Through empirical analysis, the authors identified that current LRMs lack the capability of sub-task decomposition in complex tool use scenarios, leading to "Lazy Reasoning."
12
+
13
+ To address this, D-CORE proposes a two-stage training framework:
14
+ 1. **Self-distillation**: Incentivizes the LRM's task decomposition reasoning capability.
15
+ 2. **Diversity-aware Reinforcement Learning (RL)**: Restores the LRM's reflective reasoning capability.
16
+
17
+ D-CORE achieves robust tool-use improvements across diverse benchmarks and model scales. Notably, D-CORE-14B establishes a new state-of-the-art on BFCLv3, outperforming 70B models despite being 5$\times$ smaller.
18
+
19
+ ## Resources
20
+ - **Paper**: [D-CORE: Incentivizing Task Decomposition in Large Reasoning Models for Complex Tool Use](https://huggingface.co/papers/2602.02160)
21
+ - **Arxiv**: [2602.02160](https://arxiv.org/abs/2602.02160)
22
+ - **Code**: [EfficientAI (GitHub)](https://github.com/alibaba/EfficientAI)
23
+
24
+ ## Authors
25
+ Bowen Xu, Shaoyu Wu, Hao Jiang, Kai Liu, Xin Chen, Lulu Hu, Bin Yang
26
+
27
+ ## Performance
28
+ ### BFCL
29
+ In our network environment, for the Web Search No Snippet task, we are unable to access certain websites (e.g., Wikipedia), which results in some deviation in the No Snippet scores.
30
+
31
+ <table>
32
+ <thead>
33
+ <tr>
34
+ <th rowspan="4">Model</th>
35
+ <th rowspan="4">Overall</th>
36
+ <th colspan="7" style="text-align:center">Agentic</th>
37
+ <th colspan="5" style="text-align:center">Multi Turn</th>
38
+ <th colspan="10" style="text-align:center">Single Turn</th>
39
+ <th colspan="2" style="text-align:center">Hallucination Measurement</th>
40
+ <th colspan="2" style="text-align:center">Format Sensitivity</th>
41
+ </tr>
42
+ <tr>
43
+ <th colspan="3" style="text-align:center">Web Search</th>
44
+ <th colspan="4" style="text-align:center">Memory</th>
45
+ <th rowspan="3">Overall Acc</th>
46
+ <th rowspan="3">Base</th>
47
+ <th rowspan="3">Miss Func</th>
48
+ <th rowspan="3">Miss Param</th>
49
+ <th rowspan="3">Long Context</th>
50
+ <th colspan="5" style="text-align:center">Non-live</th>
51
+ <th colspan="5" style="text-align:center">Live</th>
52
+ <th rowspan="3">Relevance</th>
53
+ <th rowspan="3">Irrelevance</th>
54
+ <th rowspan="3">Max Delta</th>
55
+ <th rowspan="3">SD</th>
56
+ </tr>
57
+ <tr>
58
+ <th rowspan="2">Summary</th>
59
+ <th rowspan="2">Base</th>
60
+ <th rowspan="2">No Snippet</th>
61
+ <th rowspan="2">Summary</th>
62
+ <th rowspan="2">KV</th>
63
+ <th rowspan="2">Vector</th>
64
+ <th rowspan="2">Recusive Sum</th>
65
+ <th rowspan="2">Overall Acc</th>
66
+ <th rowspan="2">Simple</th>
67
+ <th rowspan="2">Multiple</th>
68
+ <th rowspan="2">Parallel</th>
69
+ <th rowspan="2">Multiple Parallel</th>
70
+ <th rowspan="2">Overall Acc</th>
71
+ <th rowspan="2">Simple</th>
72
+ <th rowspan="2">Multiple</th>
73
+ <th rowspan="2">Parallel</th>
74
+ <th rowspan="2">Multiple Parallel</th>
75
+ </tr>
76
+ <tr>
77
+ </tr>
78
+ </thead>
79
+ <tbody>
80
+ <tr>
81
+ <td style="white-space: nowrap"><strong>D-CORE-8B</strong></td>
82
+ <td style="text-align: center">53.15</td>
83
+ <td style="text-align: center">23.00</td>
84
+ <td style="text-align: center">36.00</td>
85
+ <td style="text-align: center">10.00</td>
86
+ <td style="text-align: center">19.14</td>
87
+ <td style="text-align: center">9.03</td>
88
+ <td style="text-align: center">16.77</td>
89
+ <td style="text-align: center">31.61</td>
90
+ <td style="text-align: center">64.88</td>
91
+ <td style="text-align: center">75.50</td>
92
+ <td style="text-align: center">65.00</td>
93
+ <td style="text-align: center">60.50</td>
94
+ <td style="text-align: center">58.50</td>
95
+ <td style="text-align: center">86.85</td>
96
+ <td style="text-align: center">75.92</td>
97
+ <td style="text-align: center">92.50</td>
98
+ <td style="text-align: center">92.00</td>
99
+ <td style="text-align: center">87.00</td>
100
+ <td style="text-align: center">75.80</td>
101
+ <td style="text-align: center">78.29</td>
102
+ <td style="text-align: center">75.02</td>
103
+ <td style="text-align: center">100.00</td>
104
+ <td style="text-align: center">66.67</td>
105
+ <td style="text-align: center">75.00</td>
106
+ <td style="text-align: center">89.99</td>
107
+ <td style="text-align: center">75.0</td>
108
+ <td style="text-align: center">24.67</td>
109
+ </tr>
110
+ </tbody>
111
+ </table>
112
+
113
+ ### Tau-Bench & Tau2-Bench
114
+ We use Qwen3-235B-A22B-Instruct-2507 as the user model. For each task, we sample 5 times and take the average as the final result.
115
+ <table>
116
+ <thead>
117
+ <tr>
118
+ <th rowspan="3">Model</th>
119
+ <th colspan="3" style="text-align:center">Tau-Bench</th>
120
+ <th colspan="4" style="text-align:center">Tau2-Bench</th>
121
+ </tr>
122
+ <tr>
123
+ <th rowspan="2">Overall</th>
124
+ <th rowspan="2">Retail</th>
125
+ <th rowspan="2">Airline</th>
126
+ <th rowspan="2">Overall</th>
127
+ <th rowspan="2">Retail</th>
128
+ <th rowspan="2">Airline</th>
129
+ <th rowspan="2">Telecom</th>
130
+ </tr>
131
+ <tr>
132
+ </tr>
133
+ </thead>
134
+ <tbody>
135
+ <tr>
136
+ <td style="white-space: nowrap"><strong>D-CORE-8B</strong></td>
137
+ <td style="text-align: center">44.9</td>
138
+ <td style="text-align: center">53.0</td>
139
+ <td style="text-align: center">36.8</td>
140
+ <td style="text-align: center">35.8</td>
141
+ <td style="text-align: center">43.2</td>
142
+ <td style="text-align: center">37.1</td>
143
+ <td style="text-align: center">27.2</td>
144
+ </tr>
145
+ </tbody>
146
+ </table>
147
 
148
  ### ACEBench
149
+ <table>
150
+ <thead>
151
+ <tr>
152
+ <th rowspan="3">Model</th>
153
+ <th rowspan="3">Overall</th>
154
+ <th colspan="7" style="text-align:center">Atom</th>
155
+ <th colspan="3" style="text-align:center">Single Turn</th>
156
+ <th colspan="3" style="text-align:center">Multi Turn</th>
157
+ <th rowspan="3" style="text-align:center">Similar API</th>
158
+ <th rowspan="3" style="text-align:center">Preference</th>
159
+ <th rowspan="3" style="text-align:center">Summary</th>
160
+ <th colspan="4" style="text-align:center">Special</th>
161
+ <th colspan="5" style="text-align:center">Agent</th>
162
+ </tr>
163
+ <tr>
164
+ <th rowspan="2">Summary</th>
165
+ <th rowspan="2">Bool</th>
166
+ <th rowspan="2">Enum</th>
167
+ <th rowspan="2">Number</th>
168
+ <th rowspan="2">List</th>
169
+ <th rowspan="2">Object Short</th>
170
+ <th rowspan="2">Object Deep</th>
171
+ <th rowspan="2">Summary</th>
172
+ <th rowspan="2">Singal Function</th>
173
+ <th rowspan="2">Parallel Function</th>
174
+ <th rowspan="2">Summary</th>
175
+ <th rowspan="2">Switch</th>
176
+ <th rowspan="2">Adjust</th>
177
+ <th rowspan="2">Summary</th>
178
+ <th rowspan="2">Incomplete</th>
179
+ <th rowspan="2">Error</th>
180
+ <th rowspan="2">Irrelevant</th>
181
+ <th rowspan="2">Summary</th>
182
+ <th rowspan="2">Multi Turn</th>
183
+ <th rowspan="2">Multi Turn Process</th>
184
+ <th rowspan="2">Multi Step</th>
185
+ <th rowspan="2">Multi Step Process</th>
186
+ </tr>
187
+ <tr>
188
+ </tr>
189
+ </thead>
190
+ <tbody>
191
+ <tr>
192
+ <td style="white-space: nowrap"><strong>D-CORE-8B</strong></td>
193
+ <td style="text-align: center">75.2</td>
194
+ <td style="text-align: center">82.7</td>
195
+ <td style="text-align: center">90.0</td>
196
+ <td style="text-align: center">98.0</td>
197
+ <td style="text-align: center">98.0</td>
198
+ <td style="text-align: center">98.0</td>
199
+ <td style="text-align: center">36.0</td>
200
+ <td style="text-align: center">76.0</td>
201
+ <td style="text-align: center">77.5</td>
202
+ <td style="text-align: center">85.0</td>
203
+ <td style="text-align: center">70.0</td>
204
+ <td style="text-align: center">62.0</td>
205
+ <td style="text-align: center">64.0</td>
206
+ <td style="text-align: center">60.0</td>
207
+ <td style="text-align: center">78.0</td>
208
+ <td style="text-align: center">82.0</td>
209
+ <td style="text-align: center">77.9</td>
210
+ <td style="text-align: center">78.7</td>
211
+ <td style="text-align: center">58.0</td>
212
+ <td style="text-align: center">82.0</td>
213
+ <td style="text-align: center">96.0</td>
214
+ <td style="text-align: center">59.2</td>
215
+ <td style="text-align: center">43.3</td>
216
+ <td style="text-align: center">66.8</td>
217
+ <td style="text-align: center">75.0</td>
218
+ <td style="text-align: center">80.8</td>
219
+ </tr>
220
+ </tbody>
221
+ </table>
222
+
223
+ ## Citation
224
+ If you find our work useful, please cite:
225
+ ```bibtex
226
+ @article{xu2026dcore,
227
+ title={D-CORE: Incentivizing Task Decomposition in Large Reasoning Models for Complex Tool Use},
228
+ author={Xu, Bowen and Wu, Shaoyu and Jiang, Hao and Liu, Kai and Chen, Xin and Hu, Lulu and Yang, Bin},
229
+ journal={arXiv preprint arXiv:2602.02160},
230
+ year={2026}
231
+ }
232
+ ```