Junrulu commited on
Commit
c4f8990
·
verified ·
1 Parent(s): 3bb9a35

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ assets/contextpilot_overview.png filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,438 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Tencent is pleased to support the open source community by making ContextPilot-14B available.
2
+
3
+ Copyright (C) 2026 Tencent. All rights reserved.
4
+
5
+ The open-source software and/or models included in this distribution may have been modified by Tencent (“Tencent Modifications”). All Tencent Modifications are Copyright (C) Tencent.
6
+
7
+ ContextPilot-14B is licensed under the License Terms of ContextPilot-14B, except for the third-party components listed below, which remain licensed under their respective original terms. ContextPilot-14B does not impose any additional restrictions on such third-party components beyond those specified in their respective original licenses. Users are required to comply with all applicable terms and conditions of the original licenses and to ensure that the use of these third-party components conforms to all relevant laws and regulations.
8
+
9
+ For the avoidance of doubt, ContextPilot-14B refers to parameters and weights made publicly available by Tencent in this repository.
10
+
11
+ Terms of License Terms of ContextPilot-14B:
12
+ --------------------------------------------------------------------
13
+ Apache License
14
+ Version 2.0, January 2004
15
+ http://www.apache.org/licenses/
16
+
17
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
18
+
19
+ 0. ContextPilot-14B is made available solely for the purpose of scientific research and development. You shall not use it for any other purpose.
20
+
21
+ 1. Definitions.
22
+
23
+ "License" shall mean the terms and conditions for use, reproduction,
24
+ and distribution as defined by Sections 1 through 9 of this document.
25
+
26
+ "Licensor" shall mean the copyright owner or entity authorized by
27
+ the copyright owner that is granting the License.
28
+
29
+ "Legal Entity" shall mean the union of the acting entity and all
30
+ other entities that control, are controlled by, or are under common
31
+ control with that entity. For the purposes of this definition,
32
+ "control" means (i) the power, direct or indirect, to cause the
33
+ direction or management of such entity, whether by contract or
34
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
35
+ outstanding shares, or (iii) beneficial ownership of such entity.
36
+
37
+ "You" (or "Your") shall mean an individual or Legal Entity
38
+ exercising permissions granted by this License.
39
+
40
+ "Source" form shall mean the preferred form for making modifications,
41
+ including but not limited to software source code, documentation
42
+ source, and configuration files.
43
+
44
+ "Object" form shall mean any form resulting from mechanical
45
+ transformation or translation of a Source form, including but
46
+ not limited to compiled object code, generated documentation,
47
+ and conversions to other media types.
48
+
49
+ "Work" shall mean the work of authorship, whether in Source or
50
+ Object form, made available under the License, as indicated by a
51
+ copyright notice that is included in or attached to the work
52
+ (an example is provided in the Appendix below).
53
+
54
+ "Derivative Works" shall mean any work, whether in Source or Object
55
+ form, that is based on (or derived from) the Work and for which the
56
+ editorial revisions, annotations, elaborations, or other modifications
57
+ represent, as a whole, an original work of authorship. For the purposes
58
+ of this License, Derivative Works shall not include works that remain
59
+ separable from, or merely link (or bind by name) to the interfaces of,
60
+ the Work and Derivative Works thereof.
61
+
62
+ "Contribution" shall mean any work of authorship, including
63
+ the original version of the Work and any modifications or additions
64
+ to that Work or Derivative Works thereof, that is intentionally
65
+ submitted to Licensor for inclusion in the Work by the copyright owner
66
+ or by an individual or Legal Entity authorized to submit on behalf of
67
+ the copyright owner. For the purposes of this definition, "submitted"
68
+ means any form of electronic, verbal, or written communication sent
69
+ to the Licensor or its representatives, including but not limited to
70
+ communication on electronic mailing lists, source code control systems,
71
+ and issue tracking systems that are managed by, or on behalf of, the
72
+ Licensor for the purpose of discussing and improving the Work, but
73
+ excluding communication that is conspicuously marked or otherwise
74
+ designated in writing by the copyright owner as "Not a Contribution."
75
+
76
+ "Contributor" shall mean Licensor and any individual or Legal Entity
77
+ on behalf of whom a Contribution has been received by Licensor and
78
+ subsequently incorporated within the Work.
79
+
80
+ 2. Grant of Copyright License. Subject to the terms and conditions of
81
+ this License, each Contributor hereby grants to You a perpetual,
82
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
83
+ copyright license to reproduce, prepare Derivative Works of,
84
+ publicly display, publicly perform, sublicense, and distribute the
85
+ Work and such Derivative Works in Source or Object form.
86
+
87
+ 3. Grant of Patent License. Subject to the terms and conditions of
88
+ this License, each Contributor hereby grants to You a perpetual,
89
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
90
+ (except as stated in this section) patent license to make, have made,
91
+ use, offer to sell, sell, import, and otherwise transfer the Work,
92
+ where such license applies only to those patent claims licensable
93
+ by such Contributor that are necessarily infringed by their
94
+ Contribution(s) alone or by combination of their Contribution(s)
95
+ with the Work to which such Contribution(s) was submitted. If You
96
+ institute patent litigation against any entity (including a
97
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
98
+ or a Contribution incorporated within the Work constitutes direct
99
+ or contributory patent infringement, then any patent licenses
100
+ granted to You under this License for that Work shall terminate
101
+ as of the date such litigation is filed.
102
+
103
+ 4. Redistribution. You may reproduce and distribute copies of the
104
+ Work or Derivative Works thereof in any medium, with or without
105
+ modifications, and in Source or Object form, provided that You
106
+ meet the following conditions:
107
+
108
+ (a) You must give any other recipients of the Work or
109
+ Derivative Works a copy of this License; and
110
+
111
+ (b) You must cause any modified files to carry prominent notices
112
+ stating that You changed the files; and
113
+
114
+ (c) You must retain, in the Source form of any Derivative Works
115
+ that You distribute, all copyright, patent, trademark, and
116
+ attribution notices from the Source form of the Work,
117
+ excluding those notices that do not pertain to any part of
118
+ the Derivative Works; and
119
+
120
+ (d) If the Work includes a "NOTICE" text file as part of its
121
+ distribution, then any Derivative Works that You distribute must
122
+ include a readable copy of the attribution notices contained
123
+ within such NOTICE file, excluding those notices that do not
124
+ pertain to any part of the Derivative Works, in at least one
125
+ of the following places: within a NOTICE text file distributed
126
+ as part of the Derivative Works; within the Source form or
127
+ documentation, if provided along with the Derivative Works; or,
128
+ within a display generated by the Derivative Works, if and
129
+ wherever such third-party notices normally appear. The contents
130
+ of the NOTICE file are for informational purposes only and
131
+ do not modify the License. You may add Your own attribution
132
+ notices within Derivative Works that You distribute, alongside
133
+ or as an addendum to the NOTICE text from the Work, provided
134
+ that such additional attribution notices cannot be construed
135
+ as modifying the License.
136
+
137
+ You may add Your own copyright statement to Your modifications and
138
+ may provide additional or different license terms and conditions
139
+ for use, reproduction, or distribution of Your modifications, or
140
+ for any such Derivative Works as a whole, provided Your use,
141
+ reproduction, and distribution of the Work otherwise complies with
142
+ the conditions stated in this License.
143
+
144
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
145
+ any Contribution intentionally submitted for inclusion in the Work
146
+ by You to the Licensor shall be under the terms and conditions of
147
+ this License, without any additional terms or conditions.
148
+ Notwithstanding the above, nothing herein shall supersede or modify
149
+ the terms of any separate license agreement you may have executed
150
+ with Licensor regarding such Contributions.
151
+
152
+ 6. Trademarks. This License does not grant permission to use the trade
153
+ names, trademarks, service marks, or product names of the Licensor,
154
+ except as required for reasonable and customary use in describing the
155
+ origin of the Work and reproducing the content of the NOTICE file.
156
+
157
+ 7. Disclaimer of Warranty. Unless required by applicable law or
158
+ agreed to in writing, Licensor provides the Work (and each
159
+ Contributor provides its Contributions) on an "AS IS" BASIS,
160
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
161
+ implied, including, without limitation, any warranties or conditions
162
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
163
+ PARTICULAR PURPOSE. You are solely responsible for determining the
164
+ appropriateness of using or redistributing the Work and assume any
165
+ risks associated with Your exercise of permissions under this License.
166
+
167
+ 8. Limitation of Liability. In no event and under no legal theory,
168
+ whether in tort (including negligence), contract, or otherwise,
169
+ unless required by applicable law (such as deliberate and grossly
170
+ negligent acts) or agreed to in writing, shall any Contributor be
171
+ liable to You for damages, including any direct, indirect, special,
172
+ incidental, or consequential damages of any character arising as a
173
+ result of this License or out of the use or inability to use the
174
+ Work (including but not limited to damages for loss of goodwill,
175
+ work stoppage, computer failure or malfunction, or any and all
176
+ other commercial damages or losses), even if such Contributor
177
+ has been advised of the possibility of such damages.
178
+
179
+ 9. Accepting Warranty or Additional Liability. While redistributing
180
+ the Work or Derivative Works thereof, You may choose to offer,
181
+ and charge a fee for, acceptance of support, warranty, indemnity,
182
+ or other liability obligations and/or rights consistent with this
183
+ License. However, in accepting such obligations, You may act only
184
+ on Your own behalf and on Your sole responsibility, not on behalf
185
+ of any other Contributor, and only if You agree to indemnify,
186
+ defend, and hold each Contributor harmless for any liability
187
+ incurred by, or claims asserted against, such Contributor by reason
188
+ of your accepting any such warranty or additional liability.
189
+
190
+ END OF TERMS AND CONDITIONS
191
+
192
+ APPENDIX: How to apply the Apache License to your work.
193
+
194
+ To apply the Apache License to your work, attach the following
195
+ boilerplate notice, with the fields enclosed by brackets "[]"
196
+ replaced with your own identifying information. (Don't include
197
+ the brackets!) The text should be enclosed in the appropriate
198
+ comment syntax for the file format. We also recommend that a
199
+ file or class name and description of purpose be included on the
200
+ same "printed page" as the copyright notice for easier
201
+ identification within third-party archives.
202
+
203
+ Copyright [yyyy] [name of copyright owner]
204
+
205
+ Licensed under the Apache License, Version 2.0 (the "License");
206
+ you may not use this file except in compliance with the License.
207
+ You may obtain a copy of the License at
208
+
209
+ http://www.apache.org/licenses/LICENSE-2.0
210
+
211
+ Unless required by applicable law or agreed to in writing, software
212
+ distributed under the License is distributed on an "AS IS" BASIS,
213
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
214
+ See the License for the specific language governing permissions and
215
+ limitations under the License.
216
+
217
+
218
+ Dependencies and Licenses:
219
+
220
+ This open-source project, ContextPilot-14B, builds upon the following open-source models and/or software components, each of which remains licensed under its original license. Certain models or software may include modifications made by Tencent (“Tencent Modifications”), which are Copyright (C) Tencent.
221
+
222
+ In case you believe there have been errors in the attribution below, you may submit the concerns to us for review and correction.
223
+
224
+
225
+
226
+ Open Source Model Licensed under the Apache-2.0:
227
+ --------------------------------------------------------------------
228
+ 1. Qwen3-14B
229
+ Copyright 2024 Alibaba Cloud
230
+ Please note this model has been modified by Tencent in this distribution.
231
+
232
+
233
+
234
+ Terms of the Apache-2.0:
235
+ --------------------------------------------------------------------
236
+ Apache License
237
+ Version 2.0, January 2004
238
+ http://www.apache.org/licenses/
239
+
240
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
241
+
242
+ 1. Definitions.
243
+
244
+ "License" shall mean the terms and conditions for use, reproduction,
245
+ and distribution as defined by Sections 1 through 9 of this document.
246
+
247
+ "Licensor" shall mean the copyright owner or entity authorized by
248
+ the copyright owner that is granting the License.
249
+
250
+ "Legal Entity" shall mean the union of the acting entity and all
251
+ other entities that control, are controlled by, or are under common
252
+ control with that entity. For the purposes of this definition,
253
+ "control" means (i) the power, direct or indirect, to cause the
254
+ direction or management of such entity, whether by contract or
255
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
256
+ outstanding shares, or (iii) beneficial ownership of such entity.
257
+
258
+ "You" (or "Your") shall mean an individual or Legal Entity
259
+ exercising permissions granted by this License.
260
+
261
+ "Source" form shall mean the preferred form for making modifications,
262
+ including but not limited to software source code, documentation
263
+ source, and configuration files.
264
+
265
+ "Object" form shall mean any form resulting from mechanical
266
+ transformation or translation of a Source form, including but
267
+ not limited to compiled object code, generated documentation,
268
+ and conversions to other media types.
269
+
270
+ "Work" shall mean the work of authorship, whether in Source or
271
+ Object form, made available under the License, as indicated by a
272
+ copyright notice that is included in or attached to the work
273
+ (an example is provided in the Appendix below).
274
+
275
+ "Derivative Works" shall mean any work, whether in Source or Object
276
+ form, that is based on (or derived from) the Work and for which the
277
+ editorial revisions, annotations, elaborations, or other modifications
278
+ represent, as a whole, an original work of authorship. For the purposes
279
+ of this License, Derivative Works shall not include works that remain
280
+ separable from, or merely link (or bind by name) to the interfaces of,
281
+ the Work and Derivative Works thereof.
282
+
283
+ "Contribution" shall mean any work of authorship, including
284
+ the original version of the Work and any modifications or additions
285
+ to that Work or Derivative Works thereof, that is intentionally
286
+ submitted to Licensor for inclusion in the Work by the copyright owner
287
+ or by an individual or Legal Entity authorized to submit on behalf of
288
+ the copyright owner. For the purposes of this definition, "submitted"
289
+ means any form of electronic, verbal, or written communication sent
290
+ to the Licensor or its representatives, including but not limited to
291
+ communication on electronic mailing lists, source code control systems,
292
+ and issue tracking systems that are managed by, or on behalf of, the
293
+ Licensor for the purpose of discussing and improving the Work, but
294
+ excluding communication that is conspicuously marked or otherwise
295
+ designated in writing by the copyright owner as "Not a Contribution."
296
+
297
+ "Contributor" shall mean Licensor and any individual or Legal Entity
298
+ on behalf of whom a Contribution has been received by Licensor and
299
+ subsequently incorporated within the Work.
300
+
301
+ 2. Grant of Copyright License. Subject to the terms and conditions of
302
+ this License, each Contributor hereby grants to You a perpetual,
303
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
304
+ copyright license to reproduce, prepare Derivative Works of,
305
+ publicly display, publicly perform, sublicense, and distribute the
306
+ Work and such Derivative Works in Source or Object form.
307
+
308
+ 3. Grant of Patent License. Subject to the terms and conditions of
309
+ this License, each Contributor hereby grants to You a perpetual,
310
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
311
+ (except as stated in this section) patent license to make, have made,
312
+ use, offer to sell, sell, import, and otherwise transfer the Work,
313
+ where such license applies only to those patent claims licensable
314
+ by such Contributor that are necessarily infringed by their
315
+ Contribution(s) alone or by combination of their Contribution(s)
316
+ with the Work to which such Contribution(s) was submitted. If You
317
+ institute patent litigation against any entity (including a
318
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
319
+ or a Contribution incorporated within the Work constitutes direct
320
+ or contributory patent infringement, then any patent licenses
321
+ granted to You under this License for that Work shall terminate
322
+ as of the date such litigation is filed.
323
+
324
+ 4. Redistribution. You may reproduce and distribute copies of the
325
+ Work or Derivative Works thereof in any medium, with or without
326
+ modifications, and in Source or Object form, provided that You
327
+ meet the following conditions:
328
+
329
+ (a) You must give any other recipients of the Work or
330
+ Derivative Works a copy of this License; and
331
+
332
+ (b) You must cause any modified files to carry prominent notices
333
+ stating that You changed the files; and
334
+
335
+ (c) You must retain, in the Source form of any Derivative Works
336
+ that You distribute, all copyright, patent, trademark, and
337
+ attribution notices from the Source form of the Work,
338
+ excluding those notices that do not pertain to any part of
339
+ the Derivative Works; and
340
+
341
+ (d) If the Work includes a "NOTICE" text file as part of its
342
+ distribution, then any Derivative Works that You distribute must
343
+ include a readable copy of the attribution notices contained
344
+ within such NOTICE file, excluding those notices that do not
345
+ pertain to any part of the Derivative Works, in at least one
346
+ of the following places: within a NOTICE text file distributed
347
+ as part of the Derivative Works; within the Source form or
348
+ documentation, if provided along with the Derivative Works; or,
349
+ within a display generated by the Derivative Works, if and
350
+ wherever such third-party notices normally appear. The contents
351
+ of the NOTICE file are for informational purposes only and
352
+ do not modify the License. You may add Your own attribution
353
+ notices within Derivative Works that You distribute, alongside
354
+ or as an addendum to the NOTICE text from the Work, provided
355
+ that such additional attribution notices cannot be construed
356
+ as modifying the License.
357
+
358
+ You may add Your own copyright statement to Your modifications and
359
+ may provide additional or different license terms and conditions
360
+ for use, reproduction, or distribution of Your modifications, or
361
+ for any such Derivative Works as a whole, provided Your use,
362
+ reproduction, and distribution of the Work otherwise complies with
363
+ the conditions stated in this License.
364
+
365
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
366
+ any Contribution intentionally submitted for inclusion in the Work
367
+ by You to the Licensor shall be under the terms and conditions of
368
+ this License, without any additional terms or conditions.
369
+ Notwithstanding the above, nothing herein shall supersede or modify
370
+ the terms of any separate license agreement you may have executed
371
+ with Licensor regarding such Contributions.
372
+
373
+ 6. Trademarks. This License does not grant permission to use the trade
374
+ names, trademarks, service marks, or product names of the Licensor,
375
+ except as required for reasonable and customary use in describing the
376
+ origin of the Work and reproducing the content of the NOTICE file.
377
+
378
+ 7. Disclaimer of Warranty. Unless required by applicable law or
379
+ agreed to in writing, Licensor provides the Work (and each
380
+ Contributor provides its Contributions) on an "AS IS" BASIS,
381
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
382
+ implied, including, without limitation, any warranties or conditions
383
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
384
+ PARTICULAR PURPOSE. You are solely responsible for determining the
385
+ appropriateness of using or redistributing the Work and assume any
386
+ risks associated with Your exercise of permissions under this License.
387
+
388
+ 8. Limitation of Liability. In no event and under no legal theory,
389
+ whether in tort (including negligence), contract, or otherwise,
390
+ unless required by applicable law (such as deliberate and grossly
391
+ negligent acts) or agreed to in writing, shall any Contributor be
392
+ liable to You for damages, including any direct, indirect, special,
393
+ incidental, or consequential damages of any character arising as a
394
+ result of this License or out of the use or inability to use the
395
+ Work (including but not limited to damages for loss of goodwill,
396
+ work stoppage, computer failure or malfunction, or any and all
397
+ other commercial damages or losses), even if such Contributor
398
+ has been advised of the possibility of such damages.
399
+
400
+ 9. Accepting Warranty or Additional Liability. While redistributing
401
+ the Work or Derivative Works thereof, You may choose to offer,
402
+ and charge a fee for, acceptance of support, warranty, indemnity,
403
+ or other liability obligations and/or rights consistent with this
404
+ License. However, in accepting such obligations, You may act only
405
+ on Your own behalf and on Your sole responsibility, not on behalf
406
+ of any other Contributor, and only if You agree to indemnify,
407
+ defend, and hold each Contributor harmless for any liability
408
+ incurred by, or claims asserted against, such Contributor by reason
409
+ of your accepting any such warranty or additional liability.
410
+
411
+ END OF TERMS AND CONDITIONS
412
+
413
+ APPENDIX: How to apply the Apache License to your work.
414
+
415
+ To apply the Apache License to your work, attach the following
416
+ boilerplate notice, with the fields enclosed by brackets "[]"
417
+ replaced with your own identifying information. (Don't include
418
+ the brackets!) The text should be enclosed in the appropriate
419
+ comment syntax for the file format. We also recommend that a
420
+ file or class name and description of purpose be included on the
421
+ same "printed page" as the copyright notice for easier
422
+ identification within third-party archives.
423
+
424
+ Copyright [yyyy] [name of copyright owner]
425
+
426
+ Licensed under the Apache License, Version 2.0 (the "License");
427
+ you may not use this file except in compliance with the License.
428
+ You may obtain a copy of the License at
429
+
430
+ http://www.apache.org/licenses/LICENSE-2.0
431
+
432
+ Unless required by applicable law or agreed to in writing, software
433
+ distributed under the License is distributed on an "AS IS" BASIS,
434
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
435
+ See the License for the specific language governing permissions and
436
+ limitations under the License.
437
+
438
+
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ pipeline_tag: text-generation
4
+ library_name: transformers
5
+ base_model: Qwen/Qwen3-14B
6
+ tags:
7
+ - context-management
8
+ - tool-use
9
+ - agent
10
+ ---
11
+
12
+ # ContextPilot-14B
13
+
14
+ **ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL**
15
+
16
+ ContextPilot-14B is the Qwen3-14B checkpoint of **ContextPilot**, a proactive context-management framework for long-horizon language-model agents. It teaches agents to plan, maintain long-term memory, and offload less useful context while they continue reasoning and using tools. For more details, see our [paper]() and [code repository](https://github.com/Tencent/ContextPilot).
17
+
18
+ ![ContextPilot overview](assets/contextpilot_overview.png)
19
+
20
+ ## Overview
21
+
22
+ ContextPilot combines three main components:
23
+
24
+ - an extended context-management toolset with planning, structured memory, retrieval, and soft context offloading;
25
+ - context-aware partial rollout that focuses exploration on sensitive context-editing decisions; and
26
+ - fine-grained credit assignment that trains intermediate snapshots using the outcomes of their downstream branches.
27
+
28
+ The resulting agents are evaluated on long-context question answering and deep-search tasks; see the [evaluation instructions](https://github.com/Tencent/ContextPilot/tree/main/infer#evaluation) for details.
29
+
30
+ ## Loading
31
+
32
+ ```python
33
+ from transformers import AutoModelForCausalLM, AutoTokenizer
34
+
35
+ model_id = "tencent/ContextPilot-14B"
36
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
37
+ model = AutoModelForCausalLM.from_pretrained(
38
+ model_id,
39
+ torch_dtype="auto",
40
+ device_map="auto",
41
+ )
42
+ ```
43
+
44
+ Note that loading the checkpoint alone does not execute context-management tools; the tool definitions, agent runtime, and evaluation pipeline are provided in the [ContextPilot repository](https://github.com/Tencent/ContextPilot). See the [inference guide](https://github.com/Tencent/ContextPilot/blob/main/infer/README.md) for the full setup.
45
+
46
+ ## Intended Use
47
+
48
+ This checkpoint is intended for research on proactive context management, long-horizon agents, long-context QA, and deep search.
49
+
50
+ ## License
51
+
52
+ [LICENSE](https://huggingface.co/tencent/ContextPilot-14B/blob/main/LICENSE).
53
+
54
+ ## Citation
55
+
56
+ Citation details will be added with the accompanying paper.
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
assets/contextpilot_overview.png ADDED

Git LFS Details

  • SHA256: d500e879afd971a9258cc527f5192db84fe92f1404886477b3ba01c0060232b9
  • Pointer size: 131 Bytes
  • Size of remote file: 670 kB
chat_template.jinja ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- if tools %}
2
+ {{- '<|im_start|>system\n' }}
3
+ {%- if messages[0].role == 'system' %}
4
+ {{- messages[0].content + '\n\n' }}
5
+ {%- endif %}
6
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
7
+ {%- for tool in tools %}
8
+ {{- "\n" }}
9
+ {{- tool | tojson }}
10
+ {%- endfor %}
11
+ {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
12
+ {%- else %}
13
+ {%- if messages[0].role == 'system' %}
14
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
15
+ {%- endif %}
16
+ {%- endif %}
17
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
18
+ {%- for message in messages[::-1] %}
19
+ {%- set index = (messages|length - 1) - loop.index0 %}
20
+ {%- if ns.multi_step_tool and message.role == "user" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
21
+ {%- set ns.multi_step_tool = false %}
22
+ {%- set ns.last_query_index = index %}
23
+ {%- endif %}
24
+ {%- endfor %}
25
+ {%- for message in messages %}
26
+ {%- if message.content is string %}
27
+ {%- set content = message.content %}
28
+ {%- else %}
29
+ {%- set content = '' %}
30
+ {%- endif %}
31
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
32
+ {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
33
+ {%- elif message.role == "assistant" %}
34
+ {%- set reasoning_content = '' %}
35
+ {%- if message.reasoning_content is string %}
36
+ {%- set reasoning_content = message.reasoning_content %}
37
+ {%- else %}
38
+ {%- if '</think>' in content %}
39
+ {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
40
+ {%- set content = content.split('</think>')[-1].lstrip('\n') %}
41
+ {%- endif %}
42
+ {%- endif %}
43
+ {%- if loop.index0 > ns.last_query_index %}
44
+ {%- if loop.last or (not loop.last and reasoning_content) %}
45
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
46
+ {%- else %}
47
+ {{- '<|im_start|>' + message.role + '\n' + content }}
48
+ {%- endif %}
49
+ {%- else %}
50
+ {{- '<|im_start|>' + message.role + '\n' + content }}
51
+ {%- endif %}
52
+ {%- if message.tool_calls %}
53
+ {%- for tool_call in message.tool_calls %}
54
+ {%- if (loop.first and content) or (not loop.first) %}
55
+ {{- '\n' }}
56
+ {%- endif %}
57
+ {%- if tool_call.function %}
58
+ {%- set tool_call = tool_call.function %}
59
+ {%- endif %}
60
+ {{- '<tool_call>\n{"name": "' }}
61
+ {{- tool_call.name }}
62
+ {{- '", "arguments": ' }}
63
+ {%- if tool_call.arguments is string %}
64
+ {{- tool_call.arguments }}
65
+ {%- else %}
66
+ {{- tool_call.arguments | tojson }}
67
+ {%- endif %}
68
+ {{- '}\n</tool_call>' }}
69
+ {%- endfor %}
70
+ {%- endif %}
71
+ {{- '<|im_end|>\n' }}
72
+ {%- elif message.role == "tool" %}
73
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
74
+ {{- '<|im_start|>user' }}
75
+ {%- endif %}
76
+ {{- '\n<tool_response>\n' }}
77
+ {{- content }}
78
+ {{- '\n</tool_response>' }}
79
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
80
+ {{- '<|im_end|>\n' }}
81
+ {%- endif %}
82
+ {%- endif %}
83
+ {%- endfor %}
84
+ {%- if add_generation_prompt %}
85
+ {{- '<|im_start|>assistant\n' }}
86
+ {%- if enable_thinking is defined and enable_thinking is false %}
87
+ {{- '<think>\n\n</think>\n\n' }}
88
+ {%- endif %}
89
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3ForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 151643,
8
+ "eos_token_id": 151645,
9
+ "head_dim": 128,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 5120,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 17408,
14
+ "max_position_embeddings": 40960,
15
+ "max_window_layers": 40,
16
+ "model_type": "qwen3",
17
+ "num_attention_heads": 40,
18
+ "num_hidden_layers": 40,
19
+ "num_key_value_heads": 8,
20
+ "rms_norm_eps": 1e-06,
21
+ "rope_scaling": null,
22
+ "rope_theta": 1000000,
23
+ "sliding_window": null,
24
+ "tie_word_embeddings": false,
25
+ "torch_dtype": "bfloat16",
26
+ "transformers_version": "4.52.4",
27
+ "use_cache": true,
28
+ "use_sliding_window": false,
29
+ "vocab_size": 151936
30
+ }
generation_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 151643,
3
+ "do_sample": true,
4
+ "eos_token_id": [
5
+ 151645,
6
+ 151643
7
+ ],
8
+ "pad_token_id": 151643,
9
+ "temperature": 0.6,
10
+ "top_k": 20,
11
+ "top_p": 0.95,
12
+ "transformers_version": "4.52.4"
13
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8db6be18d613b6520648474df55a5b35bc0603dd0441f74470a1210f8e67ea1c
3
+ size 4963775064
model-00002-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa99c1619080f45a8ef09caef1563809befe560d4ad3126012c29dbee7e1d150
3
+ size 4953309656
model-00003-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a2537674b6df6ca23d8b9baa37b9380a3a5da783fabf4775176110588098cff
3
+ size 4834069856
model-00004-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35109802b4f4bb784ecacb2906a5a423e58d7daa692868136637db92642a988b
3
+ size 4897005056
model-00005-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:143e192a747d886d0bda9f6bb12be3ae1fd6ffe3f31a34968c62da8dc4fbd648
3
+ size 4959936040
model-00006-of-00006.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f861063f6393dd4197894659f243c96751d174ea95ab0ace2bc6bc5756e11e68
3
+ size 4928569976
model.safetensors.index.json ADDED
@@ -0,0 +1,450 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 29536614400
4
+ },
5
+ "weight_map": {
6
+ "lm_head.weight": "model-00002-of-00006.safetensors",
7
+ "model.embed_tokens.weight": "model-00001-of-00006.safetensors",
8
+ "model.layers.0.input_layernorm.weight": "model-00006-of-00006.safetensors",
9
+ "model.layers.0.mlp.down_proj.weight": "model-00004-of-00006.safetensors",
10
+ "model.layers.0.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
11
+ "model.layers.0.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
12
+ "model.layers.0.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
13
+ "model.layers.0.self_attn.k_norm.weight": "model-00004-of-00006.safetensors",
14
+ "model.layers.0.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
15
+ "model.layers.0.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
16
+ "model.layers.0.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
17
+ "model.layers.0.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
18
+ "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00006.safetensors",
19
+ "model.layers.1.input_layernorm.weight": "model-00005-of-00006.safetensors",
20
+ "model.layers.1.mlp.down_proj.weight": "model-00001-of-00006.safetensors",
21
+ "model.layers.1.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
22
+ "model.layers.1.mlp.up_proj.weight": "model-00001-of-00006.safetensors",
23
+ "model.layers.1.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
24
+ "model.layers.1.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
25
+ "model.layers.1.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
26
+ "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00006.safetensors",
27
+ "model.layers.1.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
28
+ "model.layers.1.self_attn.q_proj.weight": "model-00004-of-00006.safetensors",
29
+ "model.layers.1.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
30
+ "model.layers.10.input_layernorm.weight": "model-00001-of-00006.safetensors",
31
+ "model.layers.10.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
32
+ "model.layers.10.mlp.gate_proj.weight": "model-00005-of-00006.safetensors",
33
+ "model.layers.10.mlp.up_proj.weight": "model-00006-of-00006.safetensors",
34
+ "model.layers.10.post_attention_layernorm.weight": "model-00002-of-00006.safetensors",
35
+ "model.layers.10.self_attn.k_norm.weight": "model-00002-of-00006.safetensors",
36
+ "model.layers.10.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
37
+ "model.layers.10.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
38
+ "model.layers.10.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
39
+ "model.layers.10.self_attn.q_proj.weight": "model-00004-of-00006.safetensors",
40
+ "model.layers.10.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
41
+ "model.layers.11.input_layernorm.weight": "model-00005-of-00006.safetensors",
42
+ "model.layers.11.mlp.down_proj.weight": "model-00005-of-00006.safetensors",
43
+ "model.layers.11.mlp.gate_proj.weight": "model-00005-of-00006.safetensors",
44
+ "model.layers.11.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
45
+ "model.layers.11.post_attention_layernorm.weight": "model-00003-of-00006.safetensors",
46
+ "model.layers.11.self_attn.k_norm.weight": "model-00004-of-00006.safetensors",
47
+ "model.layers.11.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
48
+ "model.layers.11.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
49
+ "model.layers.11.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
50
+ "model.layers.11.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
51
+ "model.layers.11.self_attn.v_proj.weight": "model-00001-of-00006.safetensors",
52
+ "model.layers.12.input_layernorm.weight": "model-00002-of-00006.safetensors",
53
+ "model.layers.12.mlp.down_proj.weight": "model-00005-of-00006.safetensors",
54
+ "model.layers.12.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
55
+ "model.layers.12.mlp.up_proj.weight": "model-00003-of-00006.safetensors",
56
+ "model.layers.12.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
57
+ "model.layers.12.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
58
+ "model.layers.12.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
59
+ "model.layers.12.self_attn.o_proj.weight": "model-00005-of-00006.safetensors",
60
+ "model.layers.12.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
61
+ "model.layers.12.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
62
+ "model.layers.12.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
63
+ "model.layers.13.input_layernorm.weight": "model-00003-of-00006.safetensors",
64
+ "model.layers.13.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
65
+ "model.layers.13.mlp.gate_proj.weight": "model-00001-of-00006.safetensors",
66
+ "model.layers.13.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
67
+ "model.layers.13.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
68
+ "model.layers.13.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
69
+ "model.layers.13.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
70
+ "model.layers.13.self_attn.o_proj.weight": "model-00001-of-00006.safetensors",
71
+ "model.layers.13.self_attn.q_norm.weight": "model-00001-of-00006.safetensors",
72
+ "model.layers.13.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
73
+ "model.layers.13.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
74
+ "model.layers.14.input_layernorm.weight": "model-00004-of-00006.safetensors",
75
+ "model.layers.14.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
76
+ "model.layers.14.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
77
+ "model.layers.14.mlp.up_proj.weight": "model-00002-of-00006.safetensors",
78
+ "model.layers.14.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
79
+ "model.layers.14.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
80
+ "model.layers.14.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
81
+ "model.layers.14.self_attn.o_proj.weight": "model-00004-of-00006.safetensors",
82
+ "model.layers.14.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
83
+ "model.layers.14.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
84
+ "model.layers.14.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
85
+ "model.layers.15.input_layernorm.weight": "model-00006-of-00006.safetensors",
86
+ "model.layers.15.mlp.down_proj.weight": "model-00001-of-00006.safetensors",
87
+ "model.layers.15.mlp.gate_proj.weight": "model-00001-of-00006.safetensors",
88
+ "model.layers.15.mlp.up_proj.weight": "model-00001-of-00006.safetensors",
89
+ "model.layers.15.post_attention_layernorm.weight": "model-00001-of-00006.safetensors",
90
+ "model.layers.15.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
91
+ "model.layers.15.self_attn.k_proj.weight": "model-00004-of-00006.safetensors",
92
+ "model.layers.15.self_attn.o_proj.weight": "model-00002-of-00006.safetensors",
93
+ "model.layers.15.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
94
+ "model.layers.15.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
95
+ "model.layers.15.self_attn.v_proj.weight": "model-00002-of-00006.safetensors",
96
+ "model.layers.16.input_layernorm.weight": "model-00005-of-00006.safetensors",
97
+ "model.layers.16.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
98
+ "model.layers.16.mlp.gate_proj.weight": "model-00002-of-00006.safetensors",
99
+ "model.layers.16.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
100
+ "model.layers.16.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
101
+ "model.layers.16.self_attn.k_norm.weight": "model-00002-of-00006.safetensors",
102
+ "model.layers.16.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
103
+ "model.layers.16.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
104
+ "model.layers.16.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
105
+ "model.layers.16.self_attn.q_proj.weight": "model-00002-of-00006.safetensors",
106
+ "model.layers.16.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
107
+ "model.layers.17.input_layernorm.weight": "model-00004-of-00006.safetensors",
108
+ "model.layers.17.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
109
+ "model.layers.17.mlp.gate_proj.weight": "model-00001-of-00006.safetensors",
110
+ "model.layers.17.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
111
+ "model.layers.17.post_attention_layernorm.weight": "model-00001-of-00006.safetensors",
112
+ "model.layers.17.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
113
+ "model.layers.17.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
114
+ "model.layers.17.self_attn.o_proj.weight": "model-00005-of-00006.safetensors",
115
+ "model.layers.17.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
116
+ "model.layers.17.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
117
+ "model.layers.17.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
118
+ "model.layers.18.input_layernorm.weight": "model-00004-of-00006.safetensors",
119
+ "model.layers.18.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
120
+ "model.layers.18.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
121
+ "model.layers.18.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
122
+ "model.layers.18.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
123
+ "model.layers.18.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
124
+ "model.layers.18.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
125
+ "model.layers.18.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
126
+ "model.layers.18.self_attn.q_norm.weight": "model-00003-of-00006.safetensors",
127
+ "model.layers.18.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
128
+ "model.layers.18.self_attn.v_proj.weight": "model-00004-of-00006.safetensors",
129
+ "model.layers.19.input_layernorm.weight": "model-00006-of-00006.safetensors",
130
+ "model.layers.19.mlp.down_proj.weight": "model-00001-of-00006.safetensors",
131
+ "model.layers.19.mlp.gate_proj.weight": "model-00005-of-00006.safetensors",
132
+ "model.layers.19.mlp.up_proj.weight": "model-00001-of-00006.safetensors",
133
+ "model.layers.19.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
134
+ "model.layers.19.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
135
+ "model.layers.19.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
136
+ "model.layers.19.self_attn.o_proj.weight": "model-00004-of-00006.safetensors",
137
+ "model.layers.19.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
138
+ "model.layers.19.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
139
+ "model.layers.19.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
140
+ "model.layers.2.input_layernorm.weight": "model-00004-of-00006.safetensors",
141
+ "model.layers.2.mlp.down_proj.weight": "model-00004-of-00006.safetensors",
142
+ "model.layers.2.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
143
+ "model.layers.2.mlp.up_proj.weight": "model-00003-of-00006.safetensors",
144
+ "model.layers.2.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
145
+ "model.layers.2.self_attn.k_norm.weight": "model-00002-of-00006.safetensors",
146
+ "model.layers.2.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
147
+ "model.layers.2.self_attn.o_proj.weight": "model-00002-of-00006.safetensors",
148
+ "model.layers.2.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
149
+ "model.layers.2.self_attn.q_proj.weight": "model-00003-of-00006.safetensors",
150
+ "model.layers.2.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
151
+ "model.layers.20.input_layernorm.weight": "model-00002-of-00006.safetensors",
152
+ "model.layers.20.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
153
+ "model.layers.20.mlp.gate_proj.weight": "model-00005-of-00006.safetensors",
154
+ "model.layers.20.mlp.up_proj.weight": "model-00001-of-00006.safetensors",
155
+ "model.layers.20.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
156
+ "model.layers.20.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
157
+ "model.layers.20.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
158
+ "model.layers.20.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
159
+ "model.layers.20.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
160
+ "model.layers.20.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
161
+ "model.layers.20.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
162
+ "model.layers.21.input_layernorm.weight": "model-00005-of-00006.safetensors",
163
+ "model.layers.21.mlp.down_proj.weight": "model-00004-of-00006.safetensors",
164
+ "model.layers.21.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
165
+ "model.layers.21.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
166
+ "model.layers.21.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
167
+ "model.layers.21.self_attn.k_norm.weight": "model-00004-of-00006.safetensors",
168
+ "model.layers.21.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
169
+ "model.layers.21.self_attn.o_proj.weight": "model-00004-of-00006.safetensors",
170
+ "model.layers.21.self_attn.q_norm.weight": "model-00002-of-00006.safetensors",
171
+ "model.layers.21.self_attn.q_proj.weight": "model-00002-of-00006.safetensors",
172
+ "model.layers.21.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
173
+ "model.layers.22.input_layernorm.weight": "model-00002-of-00006.safetensors",
174
+ "model.layers.22.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
175
+ "model.layers.22.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
176
+ "model.layers.22.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
177
+ "model.layers.22.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
178
+ "model.layers.22.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
179
+ "model.layers.22.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
180
+ "model.layers.22.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
181
+ "model.layers.22.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
182
+ "model.layers.22.self_attn.q_proj.weight": "model-00001-of-00006.safetensors",
183
+ "model.layers.22.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
184
+ "model.layers.23.input_layernorm.weight": "model-00006-of-00006.safetensors",
185
+ "model.layers.23.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
186
+ "model.layers.23.mlp.gate_proj.weight": "model-00002-of-00006.safetensors",
187
+ "model.layers.23.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
188
+ "model.layers.23.post_attention_layernorm.weight": "model-00001-of-00006.safetensors",
189
+ "model.layers.23.self_attn.k_norm.weight": "model-00002-of-00006.safetensors",
190
+ "model.layers.23.self_attn.k_proj.weight": "model-00002-of-00006.safetensors",
191
+ "model.layers.23.self_attn.o_proj.weight": "model-00005-of-00006.safetensors",
192
+ "model.layers.23.self_attn.q_norm.weight": "model-00003-of-00006.safetensors",
193
+ "model.layers.23.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
194
+ "model.layers.23.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
195
+ "model.layers.24.input_layernorm.weight": "model-00006-of-00006.safetensors",
196
+ "model.layers.24.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
197
+ "model.layers.24.mlp.gate_proj.weight": "model-00001-of-00006.safetensors",
198
+ "model.layers.24.mlp.up_proj.weight": "model-00006-of-00006.safetensors",
199
+ "model.layers.24.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
200
+ "model.layers.24.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
201
+ "model.layers.24.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
202
+ "model.layers.24.self_attn.o_proj.weight": "model-00004-of-00006.safetensors",
203
+ "model.layers.24.self_attn.q_norm.weight": "model-00001-of-00006.safetensors",
204
+ "model.layers.24.self_attn.q_proj.weight": "model-00003-of-00006.safetensors",
205
+ "model.layers.24.self_attn.v_proj.weight": "model-00004-of-00006.safetensors",
206
+ "model.layers.25.input_layernorm.weight": "model-00003-of-00006.safetensors",
207
+ "model.layers.25.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
208
+ "model.layers.25.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
209
+ "model.layers.25.mlp.up_proj.weight": "model-00006-of-00006.safetensors",
210
+ "model.layers.25.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
211
+ "model.layers.25.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
212
+ "model.layers.25.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
213
+ "model.layers.25.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
214
+ "model.layers.25.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
215
+ "model.layers.25.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
216
+ "model.layers.25.self_attn.v_proj.weight": "model-00004-of-00006.safetensors",
217
+ "model.layers.26.input_layernorm.weight": "model-00004-of-00006.safetensors",
218
+ "model.layers.26.mlp.down_proj.weight": "model-00004-of-00006.safetensors",
219
+ "model.layers.26.mlp.gate_proj.weight": "model-00001-of-00006.safetensors",
220
+ "model.layers.26.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
221
+ "model.layers.26.post_attention_layernorm.weight": "model-00003-of-00006.safetensors",
222
+ "model.layers.26.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
223
+ "model.layers.26.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
224
+ "model.layers.26.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
225
+ "model.layers.26.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
226
+ "model.layers.26.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
227
+ "model.layers.26.self_attn.v_proj.weight": "model-00004-of-00006.safetensors",
228
+ "model.layers.27.input_layernorm.weight": "model-00006-of-00006.safetensors",
229
+ "model.layers.27.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
230
+ "model.layers.27.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
231
+ "model.layers.27.mlp.up_proj.weight": "model-00003-of-00006.safetensors",
232
+ "model.layers.27.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
233
+ "model.layers.27.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
234
+ "model.layers.27.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
235
+ "model.layers.27.self_attn.o_proj.weight": "model-00005-of-00006.safetensors",
236
+ "model.layers.27.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
237
+ "model.layers.27.self_attn.q_proj.weight": "model-00001-of-00006.safetensors",
238
+ "model.layers.27.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
239
+ "model.layers.28.input_layernorm.weight": "model-00006-of-00006.safetensors",
240
+ "model.layers.28.mlp.down_proj.weight": "model-00005-of-00006.safetensors",
241
+ "model.layers.28.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
242
+ "model.layers.28.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
243
+ "model.layers.28.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
244
+ "model.layers.28.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
245
+ "model.layers.28.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
246
+ "model.layers.28.self_attn.o_proj.weight": "model-00002-of-00006.safetensors",
247
+ "model.layers.28.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
248
+ "model.layers.28.self_attn.q_proj.weight": "model-00002-of-00006.safetensors",
249
+ "model.layers.28.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
250
+ "model.layers.29.input_layernorm.weight": "model-00002-of-00006.safetensors",
251
+ "model.layers.29.mlp.down_proj.weight": "model-00005-of-00006.safetensors",
252
+ "model.layers.29.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
253
+ "model.layers.29.mlp.up_proj.weight": "model-00001-of-00006.safetensors",
254
+ "model.layers.29.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
255
+ "model.layers.29.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
256
+ "model.layers.29.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
257
+ "model.layers.29.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
258
+ "model.layers.29.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
259
+ "model.layers.29.self_attn.q_proj.weight": "model-00004-of-00006.safetensors",
260
+ "model.layers.29.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
261
+ "model.layers.3.input_layernorm.weight": "model-00001-of-00006.safetensors",
262
+ "model.layers.3.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
263
+ "model.layers.3.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
264
+ "model.layers.3.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
265
+ "model.layers.3.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
266
+ "model.layers.3.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
267
+ "model.layers.3.self_attn.k_proj.weight": "model-00004-of-00006.safetensors",
268
+ "model.layers.3.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
269
+ "model.layers.3.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
270
+ "model.layers.3.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
271
+ "model.layers.3.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
272
+ "model.layers.30.input_layernorm.weight": "model-00003-of-00006.safetensors",
273
+ "model.layers.30.mlp.down_proj.weight": "model-00001-of-00006.safetensors",
274
+ "model.layers.30.mlp.gate_proj.weight": "model-00002-of-00006.safetensors",
275
+ "model.layers.30.mlp.up_proj.weight": "model-00006-of-00006.safetensors",
276
+ "model.layers.30.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
277
+ "model.layers.30.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
278
+ "model.layers.30.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
279
+ "model.layers.30.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
280
+ "model.layers.30.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
281
+ "model.layers.30.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
282
+ "model.layers.30.self_attn.v_proj.weight": "model-00004-of-00006.safetensors",
283
+ "model.layers.31.input_layernorm.weight": "model-00005-of-00006.safetensors",
284
+ "model.layers.31.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
285
+ "model.layers.31.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
286
+ "model.layers.31.mlp.up_proj.weight": "model-00003-of-00006.safetensors",
287
+ "model.layers.31.post_attention_layernorm.weight": "model-00003-of-00006.safetensors",
288
+ "model.layers.31.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
289
+ "model.layers.31.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
290
+ "model.layers.31.self_attn.o_proj.weight": "model-00005-of-00006.safetensors",
291
+ "model.layers.31.self_attn.q_norm.weight": "model-00003-of-00006.safetensors",
292
+ "model.layers.31.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
293
+ "model.layers.31.self_attn.v_proj.weight": "model-00001-of-00006.safetensors",
294
+ "model.layers.32.input_layernorm.weight": "model-00003-of-00006.safetensors",
295
+ "model.layers.32.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
296
+ "model.layers.32.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
297
+ "model.layers.32.mlp.up_proj.weight": "model-00002-of-00006.safetensors",
298
+ "model.layers.32.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
299
+ "model.layers.32.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
300
+ "model.layers.32.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
301
+ "model.layers.32.self_attn.o_proj.weight": "model-00001-of-00006.safetensors",
302
+ "model.layers.32.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
303
+ "model.layers.32.self_attn.q_proj.weight": "model-00002-of-00006.safetensors",
304
+ "model.layers.32.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
305
+ "model.layers.33.input_layernorm.weight": "model-00003-of-00006.safetensors",
306
+ "model.layers.33.mlp.down_proj.weight": "model-00005-of-00006.safetensors",
307
+ "model.layers.33.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
308
+ "model.layers.33.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
309
+ "model.layers.33.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
310
+ "model.layers.33.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
311
+ "model.layers.33.self_attn.k_proj.weight": "model-00004-of-00006.safetensors",
312
+ "model.layers.33.self_attn.o_proj.weight": "model-00004-of-00006.safetensors",
313
+ "model.layers.33.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
314
+ "model.layers.33.self_attn.q_proj.weight": "model-00004-of-00006.safetensors",
315
+ "model.layers.33.self_attn.v_proj.weight": "model-00001-of-00006.safetensors",
316
+ "model.layers.34.input_layernorm.weight": "model-00006-of-00006.safetensors",
317
+ "model.layers.34.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
318
+ "model.layers.34.mlp.gate_proj.weight": "model-00002-of-00006.safetensors",
319
+ "model.layers.34.mlp.up_proj.weight": "model-00001-of-00006.safetensors",
320
+ "model.layers.34.post_attention_layernorm.weight": "model-00001-of-00006.safetensors",
321
+ "model.layers.34.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
322
+ "model.layers.34.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
323
+ "model.layers.34.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
324
+ "model.layers.34.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
325
+ "model.layers.34.self_attn.q_proj.weight": "model-00001-of-00006.safetensors",
326
+ "model.layers.34.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
327
+ "model.layers.35.input_layernorm.weight": "model-00006-of-00006.safetensors",
328
+ "model.layers.35.mlp.down_proj.weight": "model-00005-of-00006.safetensors",
329
+ "model.layers.35.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
330
+ "model.layers.35.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
331
+ "model.layers.35.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
332
+ "model.layers.35.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
333
+ "model.layers.35.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
334
+ "model.layers.35.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
335
+ "model.layers.35.self_attn.q_norm.weight": "model-00001-of-00006.safetensors",
336
+ "model.layers.35.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
337
+ "model.layers.35.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
338
+ "model.layers.36.input_layernorm.weight": "model-00005-of-00006.safetensors",
339
+ "model.layers.36.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
340
+ "model.layers.36.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
341
+ "model.layers.36.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
342
+ "model.layers.36.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
343
+ "model.layers.36.self_attn.k_norm.weight": "model-00004-of-00006.safetensors",
344
+ "model.layers.36.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
345
+ "model.layers.36.self_attn.o_proj.weight": "model-00001-of-00006.safetensors",
346
+ "model.layers.36.self_attn.q_norm.weight": "model-00003-of-00006.safetensors",
347
+ "model.layers.36.self_attn.q_proj.weight": "model-00006-of-00006.safetensors",
348
+ "model.layers.36.self_attn.v_proj.weight": "model-00004-of-00006.safetensors",
349
+ "model.layers.37.input_layernorm.weight": "model-00004-of-00006.safetensors",
350
+ "model.layers.37.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
351
+ "model.layers.37.mlp.gate_proj.weight": "model-00005-of-00006.safetensors",
352
+ "model.layers.37.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
353
+ "model.layers.37.post_attention_layernorm.weight": "model-00002-of-00006.safetensors",
354
+ "model.layers.37.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
355
+ "model.layers.37.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
356
+ "model.layers.37.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
357
+ "model.layers.37.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
358
+ "model.layers.37.self_attn.q_proj.weight": "model-00003-of-00006.safetensors",
359
+ "model.layers.37.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
360
+ "model.layers.38.input_layernorm.weight": "model-00006-of-00006.safetensors",
361
+ "model.layers.38.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
362
+ "model.layers.38.mlp.gate_proj.weight": "model-00002-of-00006.safetensors",
363
+ "model.layers.38.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
364
+ "model.layers.38.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
365
+ "model.layers.38.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
366
+ "model.layers.38.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
367
+ "model.layers.38.self_attn.o_proj.weight": "model-00002-of-00006.safetensors",
368
+ "model.layers.38.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
369
+ "model.layers.38.self_attn.q_proj.weight": "model-00003-of-00006.safetensors",
370
+ "model.layers.38.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
371
+ "model.layers.39.input_layernorm.weight": "model-00006-of-00006.safetensors",
372
+ "model.layers.39.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
373
+ "model.layers.39.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
374
+ "model.layers.39.mlp.up_proj.weight": "model-00006-of-00006.safetensors",
375
+ "model.layers.39.post_attention_layernorm.weight": "model-00003-of-00006.safetensors",
376
+ "model.layers.39.self_attn.k_norm.weight": "model-00002-of-00006.safetensors",
377
+ "model.layers.39.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
378
+ "model.layers.39.self_attn.o_proj.weight": "model-00004-of-00006.safetensors",
379
+ "model.layers.39.self_attn.q_norm.weight": "model-00006-of-00006.safetensors",
380
+ "model.layers.39.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
381
+ "model.layers.39.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
382
+ "model.layers.4.input_layernorm.weight": "model-00006-of-00006.safetensors",
383
+ "model.layers.4.mlp.down_proj.weight": "model-00004-of-00006.safetensors",
384
+ "model.layers.4.mlp.gate_proj.weight": "model-00004-of-00006.safetensors",
385
+ "model.layers.4.mlp.up_proj.weight": "model-00006-of-00006.safetensors",
386
+ "model.layers.4.post_attention_layernorm.weight": "model-00002-of-00006.safetensors",
387
+ "model.layers.4.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
388
+ "model.layers.4.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
389
+ "model.layers.4.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
390
+ "model.layers.4.self_attn.q_norm.weight": "model-00001-of-00006.safetensors",
391
+ "model.layers.4.self_attn.q_proj.weight": "model-00002-of-00006.safetensors",
392
+ "model.layers.4.self_attn.v_proj.weight": "model-00005-of-00006.safetensors",
393
+ "model.layers.5.input_layernorm.weight": "model-00003-of-00006.safetensors",
394
+ "model.layers.5.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
395
+ "model.layers.5.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
396
+ "model.layers.5.mlp.up_proj.weight": "model-00003-of-00006.safetensors",
397
+ "model.layers.5.post_attention_layernorm.weight": "model-00005-of-00006.safetensors",
398
+ "model.layers.5.self_attn.k_norm.weight": "model-00003-of-00006.safetensors",
399
+ "model.layers.5.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
400
+ "model.layers.5.self_attn.o_proj.weight": "model-00003-of-00006.safetensors",
401
+ "model.layers.5.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
402
+ "model.layers.5.self_attn.q_proj.weight": "model-00003-of-00006.safetensors",
403
+ "model.layers.5.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
404
+ "model.layers.6.input_layernorm.weight": "model-00005-of-00006.safetensors",
405
+ "model.layers.6.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
406
+ "model.layers.6.mlp.gate_proj.weight": "model-00003-of-00006.safetensors",
407
+ "model.layers.6.mlp.up_proj.weight": "model-00002-of-00006.safetensors",
408
+ "model.layers.6.post_attention_layernorm.weight": "model-00002-of-00006.safetensors",
409
+ "model.layers.6.self_attn.k_norm.weight": "model-00005-of-00006.safetensors",
410
+ "model.layers.6.self_attn.k_proj.weight": "model-00001-of-00006.safetensors",
411
+ "model.layers.6.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
412
+ "model.layers.6.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
413
+ "model.layers.6.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
414
+ "model.layers.6.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
415
+ "model.layers.7.input_layernorm.weight": "model-00003-of-00006.safetensors",
416
+ "model.layers.7.mlp.down_proj.weight": "model-00002-of-00006.safetensors",
417
+ "model.layers.7.mlp.gate_proj.weight": "model-00001-of-00006.safetensors",
418
+ "model.layers.7.mlp.up_proj.weight": "model-00002-of-00006.safetensors",
419
+ "model.layers.7.post_attention_layernorm.weight": "model-00006-of-00006.safetensors",
420
+ "model.layers.7.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
421
+ "model.layers.7.self_attn.k_proj.weight": "model-00006-of-00006.safetensors",
422
+ "model.layers.7.self_attn.o_proj.weight": "model-00005-of-00006.safetensors",
423
+ "model.layers.7.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
424
+ "model.layers.7.self_attn.q_proj.weight": "model-00001-of-00006.safetensors",
425
+ "model.layers.7.self_attn.v_proj.weight": "model-00006-of-00006.safetensors",
426
+ "model.layers.8.input_layernorm.weight": "model-00001-of-00006.safetensors",
427
+ "model.layers.8.mlp.down_proj.weight": "model-00003-of-00006.safetensors",
428
+ "model.layers.8.mlp.gate_proj.weight": "model-00006-of-00006.safetensors",
429
+ "model.layers.8.mlp.up_proj.weight": "model-00004-of-00006.safetensors",
430
+ "model.layers.8.post_attention_layernorm.weight": "model-00004-of-00006.safetensors",
431
+ "model.layers.8.self_attn.k_norm.weight": "model-00006-of-00006.safetensors",
432
+ "model.layers.8.self_attn.k_proj.weight": "model-00005-of-00006.safetensors",
433
+ "model.layers.8.self_attn.o_proj.weight": "model-00002-of-00006.safetensors",
434
+ "model.layers.8.self_attn.q_norm.weight": "model-00005-of-00006.safetensors",
435
+ "model.layers.8.self_attn.q_proj.weight": "model-00005-of-00006.safetensors",
436
+ "model.layers.8.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
437
+ "model.layers.9.input_layernorm.weight": "model-00006-of-00006.safetensors",
438
+ "model.layers.9.mlp.down_proj.weight": "model-00006-of-00006.safetensors",
439
+ "model.layers.9.mlp.gate_proj.weight": "model-00005-of-00006.safetensors",
440
+ "model.layers.9.mlp.up_proj.weight": "model-00005-of-00006.safetensors",
441
+ "model.layers.9.post_attention_layernorm.weight": "model-00003-of-00006.safetensors",
442
+ "model.layers.9.self_attn.k_norm.weight": "model-00004-of-00006.safetensors",
443
+ "model.layers.9.self_attn.k_proj.weight": "model-00003-of-00006.safetensors",
444
+ "model.layers.9.self_attn.o_proj.weight": "model-00006-of-00006.safetensors",
445
+ "model.layers.9.self_attn.q_norm.weight": "model-00004-of-00006.safetensors",
446
+ "model.layers.9.self_attn.q_proj.weight": "model-00003-of-00006.safetensors",
447
+ "model.layers.9.self_attn.v_proj.weight": "model-00003-of-00006.safetensors",
448
+ "model.norm.weight": "model-00002-of-00006.safetensors"
449
+ }
450
+ }
selective_merge.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "formula": "anchor + weight * selective_mask * (vector - vector_base)",
3
+ "anchor": "/workspace/zhuoshipan/research/ACM/agentic_verl/saves/sft/Qwen3-14B/qwen3-14b-v124-long-closedloop-v132-step10-20260811/global_step_10/huggingface",
4
+ "vector": "/workspace/zhuoshipan/research/ACM/agentic_verl/saves/sft/Qwen3-14B/qwen3-14b-v132-novel-closedloop-v133-step10-20260811/global_step_10/huggingface",
5
+ "vector_base": "/workspace/zhuoshipan/research/ACM/agentic_verl/saves/sft/Qwen3-14B/qwen3-14b-v124-long-closedloop-v132-step10-20260811/global_step_10/huggingface",
6
+ "protect_base": null,
7
+ "protect_vector": null,
8
+ "protect_vector_base": null,
9
+ "weight": 1.5,
10
+ "mode": "all",
11
+ "conflict_scale": 0.0,
12
+ "density": null,
13
+ "layers": [
14
+ 0,
15
+ 1,
16
+ 2,
17
+ 3,
18
+ 4,
19
+ 5,
20
+ 6,
21
+ 7,
22
+ 8,
23
+ 9
24
+ ],
25
+ "include_non_layer": false,
26
+ "key_regex": "mlp",
27
+ "exclude_key_regex": null,
28
+ "stats": {
29
+ "floating_coordinates": 14768307200,
30
+ "selected_coordinates": 2673868800,
31
+ "conflicting_coordinates": 0,
32
+ "layer_filtered_coordinates": 12094438400,
33
+ "tensors": 443,
34
+ "changed_tensors": 30,
35
+ "selected_fraction": 1.0
36
+ }
37
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|im_end|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": {
25
+ "content": "<|endoftext|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
3
+ size 11422654
tokenizer_config.json ADDED
@@ -0,0 +1,239 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>"
228
+ ],
229
+ "bos_token": null,
230
+ "clean_up_tokenization_spaces": false,
231
+ "eos_token": "<|im_end|>",
232
+ "errors": "replace",
233
+ "extra_special_tokens": {},
234
+ "model_max_length": 131072,
235
+ "pad_token": "<|endoftext|>",
236
+ "split_special_tokens": false,
237
+ "tokenizer_class": "Qwen2Tokenizer",
238
+ "unk_token": null
239
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff