null commited on
Commit ·
de1c6c8
0
Parent(s):
feat: publish BotPsy WebGPU browser model packages
Browse filesAdd Q8_0, Q4_K_M, mixed and vision packages for the browser runtime.
This view is limited to 50 files because it contains too many changes. See raw diff
- .gitattributes +2 -0
- README.md +46 -0
- botpsy-0.8b-mixed/assets/attribution-dcc5f18a858ad472-ATTRIBUTIONS.md +0 -0
- botpsy-0.8b-mixed/assets/config-1dd43fe49e93b477-config.json +3 -0
- botpsy-0.8b-mixed/assets/license-c71d239df91726fc-LICENSE +201 -0
- botpsy-0.8b-mixed/assets/processor-d89ef49ce9cd37fb-processor_config.json +3 -0
- botpsy-0.8b-mixed/assets/readme-959811cca18e73a6-README.md +284 -0
- botpsy-0.8b-mixed/assets/template-6d877b321d680a20-chat_template.jinja +157 -0
- botpsy-0.8b-mixed/assets/tokenizer-06b9509352d2af50-tokenizer.json +3 -0
- botpsy-0.8b-mixed/conversion-report.json +3 -0
- botpsy-0.8b-mixed/manifest.json +3 -0
- botpsy-0.8b-mixed/shard-000.bin +3 -0
- botpsy-0.8b-mixed/shard-001.bin +3 -0
- botpsy-0.8b-mixed/shard-002.bin +3 -0
- botpsy-0.8b-mixed/shard-003.bin +3 -0
- botpsy-0.8b-mixed/shard-004.bin +3 -0
- botpsy-0.8b-mixed/shard-005.bin +3 -0
- botpsy-0.8b-mixed/shard-006.bin +3 -0
- botpsy-0.8b-mixed/shard-007.bin +3 -0
- botpsy-0.8b-mixed/shard-008.bin +3 -0
- botpsy-0.8b-q4_k_m/assets/attribution-dcc5f18a858ad472-ATTRIBUTIONS.md +0 -0
- botpsy-0.8b-q4_k_m/assets/config-1dd43fe49e93b477-config.json +3 -0
- botpsy-0.8b-q4_k_m/assets/license-c71d239df91726fc-LICENSE +201 -0
- botpsy-0.8b-q4_k_m/assets/processor-d89ef49ce9cd37fb-processor_config.json +3 -0
- botpsy-0.8b-q4_k_m/assets/readme-959811cca18e73a6-README.md +284 -0
- botpsy-0.8b-q4_k_m/assets/template-6d877b321d680a20-chat_template.jinja +157 -0
- botpsy-0.8b-q4_k_m/assets/tokenizer-06b9509352d2af50-tokenizer.json +3 -0
- botpsy-0.8b-q4_k_m/conversion-report.json +3 -0
- botpsy-0.8b-q4_k_m/manifest.json +3 -0
- botpsy-0.8b-q4_k_m/shard-000.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-001.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-002.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-003.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-004.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-005.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-006.bin +3 -0
- botpsy-0.8b-q4_k_m/shard-007.bin +3 -0
- botpsy-0.8b-q8_0/assets/attribution-dcc5f18a858ad472-ATTRIBUTIONS.md +0 -0
- botpsy-0.8b-q8_0/assets/config-1dd43fe49e93b477-config.json +3 -0
- botpsy-0.8b-q8_0/assets/license-c71d239df91726fc-LICENSE +201 -0
- botpsy-0.8b-q8_0/assets/processor-d89ef49ce9cd37fb-processor_config.json +3 -0
- botpsy-0.8b-q8_0/assets/readme-959811cca18e73a6-README.md +284 -0
- botpsy-0.8b-q8_0/assets/template-6d877b321d680a20-chat_template.jinja +157 -0
- botpsy-0.8b-q8_0/assets/tokenizer-06b9509352d2af50-tokenizer.json +3 -0
- botpsy-0.8b-q8_0/conversion-report.json +3 -0
- botpsy-0.8b-q8_0/manifest.json +3 -0
- botpsy-0.8b-q8_0/shard-000.bin +3 -0
- botpsy-0.8b-q8_0/shard-001.bin +3 -0
- botpsy-0.8b-q8_0/shard-002.bin +3 -0
- botpsy-0.8b-q8_0/shard-003.bin +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.json filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: qvac/BotPsy-0.8B
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
+
tags:
|
| 6 |
+
- webgpu
|
| 7 |
+
- browser
|
| 8 |
+
- qwen3_5
|
| 9 |
+
- q8_0
|
| 10 |
+
- q4_k_m
|
| 11 |
+
- vision
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# BotPsy 0.8B WebGPU
|
| 15 |
+
|
| 16 |
+
Browser-ready packages compiled from [`qvac/BotPsy-0.8B`](https://huggingface.co/qvac/BotPsy-0.8B)
|
| 17 |
+
at revision `24561e9681643eaf807fc28b0875210cb17f89c1`.
|
| 18 |
+
|
| 19 |
+
These are custom manifest-and-shard packages for the BotPsy browser runtime. They are
|
| 20 |
+
not standard Transformers or GGUF repositories. The runtime consumes each directory's
|
| 21 |
+
`manifest.json`, verifies every shard/asset SHA-256, and installs immutable bytes into
|
| 22 |
+
OPFS.
|
| 23 |
+
|
| 24 |
+
## Packages
|
| 25 |
+
|
| 26 |
+
| Directory | Contents |
|
| 27 |
+
|---|---|
|
| 28 |
+
| `botpsy-0.8b-q8_0/` | Publisher Q8_0 text weights, tokenizer, template and assets |
|
| 29 |
+
| `botpsy-0.8b-q4_k_m/` | Publisher Q4_K_M text weights, tokenizer, template and assets |
|
| 30 |
+
| `botpsy-0.8b-mixed/` | Q8 attention projections plus the Q4_K_M remainder |
|
| 31 |
+
| `botpsy-vision-bf16-f32/` | Separate 12-layer vision tower package |
|
| 32 |
+
|
| 33 |
+
The production chat application fetches these files from:
|
| 34 |
+
|
| 35 |
+
```text
|
| 36 |
+
https://huggingface.co/leventkoldas/botpsy-0.8b-webgpu/resolve/main/<package>/manifest.json
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
The browser application either uses its built-in default model base URL or the
|
| 40 |
+
`VITE_MODEL_BASE_URL` build-time override.
|
| 41 |
+
|
| 42 |
+
## Attribution
|
| 43 |
+
|
| 44 |
+
Model weights and architecture are from `qvac/BotPsy-0.8B`, licensed Apache-2.0.
|
| 45 |
+
See each package's `assets/` directory for the upstream license, attributions and
|
| 46 |
+
model card.
|
botpsy-0.8b-mixed/assets/attribution-dcc5f18a858ad472-ATTRIBUTIONS.md
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
botpsy-0.8b-mixed/assets/config-1dd43fe49e93b477-config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1dd43fe49e93b4778f67be093bf1d03b3a6cadf487ff5585ab7ffb2b34631543
|
| 3 |
+
size 2701
|
botpsy-0.8b-mixed/assets/license-c71d239df91726fc-LICENSE
ADDED
|
@@ -0,0 +1,201 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Apache License
|
| 2 |
+
Version 2.0, January 2004
|
| 3 |
+
http://www.apache.org/licenses/
|
| 4 |
+
|
| 5 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 6 |
+
|
| 7 |
+
1. Definitions.
|
| 8 |
+
|
| 9 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 10 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 11 |
+
|
| 12 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 13 |
+
the copyright owner that is granting the License.
|
| 14 |
+
|
| 15 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 16 |
+
other entities that control, are controlled by, or are under common
|
| 17 |
+
control with that entity. For the purposes of this definition,
|
| 18 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 19 |
+
direction or management of such entity, whether by contract or
|
| 20 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 21 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 22 |
+
|
| 23 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 24 |
+
exercising permissions granted by this License.
|
| 25 |
+
|
| 26 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 27 |
+
including but not limited to software source code, documentation
|
| 28 |
+
source, and configuration files.
|
| 29 |
+
|
| 30 |
+
"Object" form shall mean any form resulting from mechanical
|
| 31 |
+
transformation or translation of a Source form, including but
|
| 32 |
+
not limited to compiled object code, generated documentation,
|
| 33 |
+
and conversions to other media types.
|
| 34 |
+
|
| 35 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 36 |
+
Object form, made available under the License, as indicated by a
|
| 37 |
+
copyright notice that is included in or attached to the work
|
| 38 |
+
(an example is provided in the Appendix below).
|
| 39 |
+
|
| 40 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 41 |
+
form, that is based on (or derived from) the Work and for which the
|
| 42 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 43 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 44 |
+
of this License, Derivative Works shall not include works that remain
|
| 45 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 46 |
+
the Work and Derivative Works thereof.
|
| 47 |
+
|
| 48 |
+
"Contribution" shall mean any work of authorship, including
|
| 49 |
+
the original version of the Work and any modifications or additions
|
| 50 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 51 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 52 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 53 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 54 |
+
means any form of electronic, verbal, or written communication sent
|
| 55 |
+
to the Licensor or its representatives, including but not limited to
|
| 56 |
+
communication on electronic mailing lists, source code control systems,
|
| 57 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 58 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 59 |
+
excluding communication that is conspicuously marked or otherwise
|
| 60 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 61 |
+
|
| 62 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 63 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 64 |
+
subsequently incorporated within the Work.
|
| 65 |
+
|
| 66 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 67 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 68 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 69 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 70 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 71 |
+
Work and such Derivative Works in Source or Object form.
|
| 72 |
+
|
| 73 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 74 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 75 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 76 |
+
(except as stated in this section) patent license to make, have made,
|
| 77 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 78 |
+
where such license applies only to those patent claims licensable
|
| 79 |
+
by such Contributor that are necessarily infringed by their
|
| 80 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 81 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 82 |
+
institute patent litigation against any entity (including a
|
| 83 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 84 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 85 |
+
or contributory patent infringement, then any patent licenses
|
| 86 |
+
granted to You under this License for that Work shall terminate
|
| 87 |
+
as of the date such litigation is filed.
|
| 88 |
+
|
| 89 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 90 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 91 |
+
modifications, and in Source or Object form, provided that You
|
| 92 |
+
meet the following conditions:
|
| 93 |
+
|
| 94 |
+
(a) You must give any other recipients of the Work or
|
| 95 |
+
Derivative Works a copy of this License; and
|
| 96 |
+
|
| 97 |
+
(b) You must cause any modified files to carry prominent notices
|
| 98 |
+
stating that You changed the files; and
|
| 99 |
+
|
| 100 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 101 |
+
that You distribute, all copyright, patent, trademark, and
|
| 102 |
+
attribution notices from the Source form of the Work,
|
| 103 |
+
excluding those notices that do not pertain to any part of
|
| 104 |
+
the Derivative Works; and
|
| 105 |
+
|
| 106 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 107 |
+
distribution, then any Derivative Works that You distribute must
|
| 108 |
+
include a readable copy of the attribution notices contained
|
| 109 |
+
within such NOTICE file, excluding those notices that do not
|
| 110 |
+
pertain to any part of the Derivative Works, in at least one
|
| 111 |
+
of the following places: within a NOTICE text file distributed
|
| 112 |
+
as part of the Derivative Works; within the Source form or
|
| 113 |
+
documentation, if provided along with the Derivative Works; or,
|
| 114 |
+
within a display generated by the Derivative Works, if and
|
| 115 |
+
wherever such third-party notices normally appear. The contents
|
| 116 |
+
of the NOTICE file are for informational purposes only and
|
| 117 |
+
do not modify the License. You may add Your own attribution
|
| 118 |
+
notices within Derivative Works that You distribute, alongside
|
| 119 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 120 |
+
that such additional attribution notices cannot be construed
|
| 121 |
+
as modifying the License.
|
| 122 |
+
|
| 123 |
+
You may add Your own copyright statement to Your modifications and
|
| 124 |
+
may provide additional or different license terms and conditions
|
| 125 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 126 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 127 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 128 |
+
the conditions stated in this License.
|
| 129 |
+
|
| 130 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 131 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 132 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 133 |
+
this License, without any additional terms or conditions.
|
| 134 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 135 |
+
the terms of any separate license agreement you may have executed
|
| 136 |
+
with Licensor regarding such Contributions.
|
| 137 |
+
|
| 138 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 139 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 140 |
+
except as required for reasonable and customary use in describing the
|
| 141 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 142 |
+
|
| 143 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 144 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 145 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 146 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 147 |
+
implied, including, without limitation, any warranties or conditions
|
| 148 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 149 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 150 |
+
appropriateness of using or redistributing the Work and assume any
|
| 151 |
+
risks associated with Your exercise of permissions under this License.
|
| 152 |
+
|
| 153 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 154 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 155 |
+
unless required by applicable law (such as deliberate and grossly
|
| 156 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 157 |
+
liable to You for damages, including any direct, indirect, special,
|
| 158 |
+
incidental, or consequential damages of any character arising as a
|
| 159 |
+
result of this License or out of the use or inability to use the
|
| 160 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 161 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 162 |
+
other commercial damages or losses), even if such Contributor
|
| 163 |
+
has been advised of the possibility of such damages.
|
| 164 |
+
|
| 165 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 166 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 167 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 168 |
+
or other liability obligations and/or rights consistent with this
|
| 169 |
+
License. However, in accepting such obligations, You may act only
|
| 170 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 171 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 172 |
+
defend, and hold each Contributor harmless for any liability
|
| 173 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 174 |
+
of your accepting any such warranty or additional liability.
|
| 175 |
+
|
| 176 |
+
END OF TERMS AND CONDITIONS
|
| 177 |
+
|
| 178 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 179 |
+
|
| 180 |
+
To apply the Apache License to your work, attach the following
|
| 181 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 182 |
+
replaced with your own identifying information. (Don't include
|
| 183 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 184 |
+
comment syntax for the file format. We also recommend that a
|
| 185 |
+
file or class name and description of purpose be included on the
|
| 186 |
+
same "printed page" as the copyright notice for easier
|
| 187 |
+
identification within third-party archives.
|
| 188 |
+
|
| 189 |
+
Copyright [yyyy] [name of copyright owner]
|
| 190 |
+
|
| 191 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 192 |
+
you may not use this file except in compliance with the License.
|
| 193 |
+
You may obtain a copy of the License at
|
| 194 |
+
|
| 195 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 196 |
+
|
| 197 |
+
Unless required by applicable law or agreed to in writing, software
|
| 198 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 199 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 200 |
+
See the License for the specific language governing permissions and
|
| 201 |
+
limitations under the License.
|
botpsy-0.8b-mixed/assets/processor-d89ef49ce9cd37fb-processor_config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d89ef49ce9cd37fbf510158e13c1ef063d9286411c1ec9049932dbe0487143b1
|
| 3 |
+
size 1191
|
botpsy-0.8b-mixed/assets/readme-959811cca18e73a6-README.md
ADDED
|
@@ -0,0 +1,284 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
license_link: https://huggingface.co/qvac/BotPsy-0.8B/blob/main/LICENSE
|
| 4 |
+
language:
|
| 5 |
+
- en
|
| 6 |
+
library_name: transformers
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
+
base_model:
|
| 9 |
+
- Qwen/Qwen3.5-0.8B
|
| 10 |
+
base_model_relation: finetune
|
| 11 |
+
tags:
|
| 12 |
+
- tool-calling
|
| 13 |
+
- function-calling
|
| 14 |
+
- agent
|
| 15 |
+
- agentic
|
| 16 |
+
- on-device
|
| 17 |
+
- edge
|
| 18 |
+
- qwen3_5
|
| 19 |
+
- tether-ai
|
| 20 |
+
- qvac
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
# BotPsy-0.8B
|
| 24 |
+
|
| 25 |
+
**BotPsy-0.8B** is a 0.8B-parameter model designed for function calling and agentic workflows, built on top of [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) and suitable for on-device deployment. BotPsy is a "personal assistant" that uses tools to perform a variety of simple tasks for the user, in domains such as web search & research, travel & lifestyle, commerce & finance, business & customer operations, device & vehicle control, files & documents, calendar, and email & messaging. Due to its small parameter count, it is best suited to tasks of low to medium difficulty. BotPsy achieves state-of-the-art (SOTA) tool-use and agentic performance for its size, outperforming every model of up to 1.2B parameters that we tested. As a small model, BotPsy still makes mistakes and is best suited to tasks of low to medium difficulty; please read the [Intended Use and Limitations](#intended-use-and-limitations) section for more information.
|
| 26 |
+
|
| 27 |
+
This repository holds the BF16 weights in Hugging Face safetensors format. GGUF files (BF16, Q8_0 and Q4_K_M) for llama.cpp and the QVAC SDK are in [qvac/BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs). The full write-up, with every benchmark and the training method, is the [BotPsy blog post](https://huggingface.co/blog/qvac/botpsy).
|
| 28 |
+
|
| 29 |
+
| | |
|
| 30 |
+
|:---|:---|
|
| 31 |
+
| **Developed by** | [Tether AI Research](https://tether.io/)<sup>*</sup> |
|
| 32 |
+
| **Model type** | Causal language model for tool calling (Qwen3.5 architecture: hybrid Gated DeltaNet + gated attention), used text-only |
|
| 33 |
+
| **Parameters** | 0.8B |
|
| 34 |
+
| **Base model** | [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) |
|
| 35 |
+
| **Reasoning** | Thinks before it answers (thinking mode, `enable_thinking=True`) |
|
| 36 |
+
| **Language** | English (recommended) |
|
| 37 |
+
| **Precision** | BF16 (this repository); BF16, Q8_0 and Q4_K_M GGUF in [BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs) |
|
| 38 |
+
| **License** | [Apache 2.0](https://huggingface.co/qvac/BotPsy-0.8B/blob/main/LICENSE) |
|
| 39 |
+
| **Blog post** | [BotPsy on Hugging Face](https://huggingface.co/blog/qvac/botpsy) |
|
| 40 |
+
| **Collection** | [BotPsy](https://huggingface.co/collections/qvac/botpsy) |
|
| 41 |
+
|
| 42 |
+
<sup>*</sup> References to Tether AI Research are references to Tether Data, S.A. de C.V.
|
| 43 |
+
|
| 44 |
+
## Key Highlights
|
| 45 |
+
|
| 46 |
+
### Benchmark results
|
| 47 |
+
- **Twice the performance of its base model:** BotPsy roughly doubles the agentic capability of Qwen3.5-0.8B-Think on key benchmarks: BFCL v4 rises from 23.4 to 44.0, ACEBench from 30.1 to 58.7, and τ-bench from 23.2 to 51.5 (mean of the retail, telecom and banking subsets).
|
| 48 |
+
- **Best agent in its category:** BotPsy outperforms leading models in the ≤1.2B-parameter weight class (Qwen3.5-0.8B-Think, LFM2.5-1.2B-Think, MiniCPM5-1B-Think) on all six tool-use and agentic benchmarks: BFCL v4, ACEBench, τ-bench, ToolSandbox, Claw-Eval and BrowseComp-Plus.
|
| 49 |
+
- **Outperforms its larger sibling:** BotPsy has the highest score of all models tested on five of the six benchmarks, beating Qwen3.5-2B-Think, a model 2.5× its size, on BFCL v4 (44.0 vs 37.7), ACEBench (58.7 vs 55.4), τ-bench (51.5 vs 46.5), ToolSandbox (64.6 vs 41.2) and BrowseComp-Plus (4.5 vs 2.8). Only on Claw-Eval does Qwen3.5-2B-Think lead (48.9 vs 46.5).
|
| 50 |
+
|
| 51 |
+
### Model capabilities
|
| 52 |
+
- **More reliable in multi-turn workflows:** On τ²-bench, where the agent must hold a long customer conversation, follow a strict policy, and act on the customer's behalf, it scores 82.5 in telecom, ahead of Qwen3.5-2B-Think (69.3). On BFCL v4's multi-turn tasks, it rises from 7.5 to 46.1 over its base, nearly double Qwen3.5-2B-Think (23.8). Grouped by application, its multi-step scores lead all models tested in commerce and services (58.3 vs 47.4 for the next best, Qwen3.5-2B-Think) and in device and system management (46.1 vs 31.9).
|
| 53 |
+
- **Knows when (not) to call tools:** An agent that acts must also know when not to act. On BFCL v4's hallucination tests, which check that the model declines when no appropriate tool exists, BotPsy scores 86.1, the highest of all models tested. On ACEBench's special cases, where the request is incomplete, contains wrong parameters, or cannot be served by the given tools, it scores 51.3, up from 13.7 for its base model.
|
| 54 |
+
- **Follows instructions while preserving knowledge:** BotPsy specializes in tool use while preserving general skills. Instruction following improves sharply, with IFEval rising from 59.7 to 90.8 and IFBench from 22.0 to 55.9, the highest IFBench score of all models tested. General knowledge also improves, with GPQA Diamond rising from 33.2 to 38.1 and MMLU-Pro from 41.6 to 48.9. On all four benchmarks, BotPsy outperforms every other model of 1.2B parameters or fewer that we tested.
|
| 55 |
+
|
| 56 |
+
## Benchmark Results
|
| 57 |
+
|
| 58 |
+
All five models were evaluated in thinking mode with one shared evaluation harness. BotPsy was served from these BF16 weights with vLLM. Best score per row in **bold**, second best <u>underlined</u>; multipliers give parameter count relative to BotPsy-0.8B.
|
| 59 |
+
|
| 60 |
+
| Benchmark | **BotPsy-0.8B**<br><sub>ours</sub> | Qwen3.5-0.8B-Think<br><sub>base · 1×</sub> | Qwen3.5-2B-Think<br><sub>2.5×</sub> | LFM2.5-1.2B-Think<br><sub>1.5×</sub> | MiniCPM5-1B-Think<br><sub>1.25×</sub> |
|
| 61 |
+
| :--- | :---: | :---: | :---: | :---: | :---: |
|
| 62 |
+
| ***Tool use & agents*** | | | | | |
|
| 63 |
+
| BFCL v4¹ | **44.0** | 23.4 | <u>37.7</u> | 28.1 | 22.8 |
|
| 64 |
+
| ACEBench² | **58.7** | 30.1 | <u>55.4</u> | 39.4 | 24.5 |
|
| 65 |
+
| τ-bench³ | **51.5** | 23.2 | <u>46.5</u> | 6.5 | 28.8 |
|
| 66 |
+
| Claw-Eval⁴ | <u>46.5</u> | 39.3 | **48.9** | 31.6 | 31.0 |
|
| 67 |
+
| BrowseComp-Plus⁵ | **4.5** | 1.9 | <u>2.8</u> | 0.2 | 0.8 |
|
| 68 |
+
| ToolSandbox⁶ | **64.6** | 30.5 | 41.2 | <u>45.7</u> | 28.1 |
|
| 69 |
+
| *Average* | ***45.0*** | *24.7* | *<u>38.8</u>* | *25.3* | *22.7* |
|
| 70 |
+
| ***Knowledge*** | | | | | |
|
| 71 |
+
| GPQA Diamond⁷ | <u>38.1</u> | 33.2 | **59.9** | 35.0 | 15.8 |
|
| 72 |
+
| MMLU-Pro⁸ | <u>48.9</u> | 41.6 | **65.5** | 39.4 | 40.0 |
|
| 73 |
+
| ***Instruction following*** | | | | | |
|
| 74 |
+
| IFEval⁹ | **90.8** | 59.7 | 80.0 | <u>85.6</u> | 78.4 |
|
| 75 |
+
| IFBench⁹ | **55.9** | 22.0 | <u>40.9</u> | 33.9 | 40.6 |
|
| 76 |
+
| Multi-IF¹⁰ | <u>67.2</u> | 43.2 | 66.9 | **68.2** | 53.4 |
|
| 77 |
+
|
| 78 |
+
<details>
|
| 79 |
+
<summary>Evaluation footnotes</summary>
|
| 80 |
+
|
| 81 |
+
- All scores are percentages (higher is better).
|
| 82 |
+
- All models were evaluated in thinking (reasoning) mode.
|
| 83 |
+
- All benchmarks that use an external API were run on **November 3, 2026**.
|
| 84 |
+
- ¹ BFCL v4: overall score calculated using the official weighted formula (40% Agentic, 30% Multi-Turn, 10% Live, 10% Non-Live, and 10% Hallucination), averaged over 3 runs.
|
| 85 |
+
- ² ACEBench: overall accuracy. All models were evaluated in function-calling (FC) mode; mean of 2 runs.
|
| 86 |
+
- ³ τ-bench: average of τ²-bench (retail, telecom) and τ³-bench (banking), excluding airline; mean of 3 runs.
|
| 87 |
+
- ⁴ Claw-Eval: official average task score, where each task scores safety × (0.8 × completion + 0.2 × robustness); mean of 3 runs.
|
| 88 |
+
- ⁵ BrowseComp-Plus: accuracy, with a maximum of 30 steps for all models.
|
| 89 |
+
- ⁶ ToolSandbox: mean similarity score over 8 settings.
|
| 90 |
+
- ⁷ GPQA Diamond: accuracy over all 198 questions, mean of 3 runs, thinking enabled.
|
| 91 |
+
- ⁸ MMLU-Pro: accuracy.
|
| 92 |
+
- ⁹ IFEval, IFBench: prompt-level strict accuracy.
|
| 93 |
+
- ¹⁰ Multi-IF: average of 3 runs.
|
| 94 |
+
|
| 95 |
+
</details>
|
| 96 |
+
|
| 97 |
+
BotPsy's weaker spots are open-ended search and a few areas where Qwen3.5-2B-Think still leads: BrowseComp-Plus deep research (4.5, the best of the five but low in absolute terms), BFCL web search (14.0) and memory (16.3), Claw-Eval, and ACEBench's special cases. On τ³-banking no model gets above 5. Knowledge still scales mainly with parameter count, so BotPsy is designed to call tools for facts it does not know, not to serve as a knowledge model. See the [blog post](https://huggingface.co/blog/qvac/botpsy) for the multi-turn, app-level and efficiency analyses.
|
| 98 |
+
|
| 99 |
+
## Training
|
| 100 |
+
|
| 101 |
+
BotPsy is based on Qwen3.5-0.8B and is post-trained in four stages: supervised fine-tuning, multi-teacher on-policy distillation, and two rounds of reinforcement learning. See the [blog post (Methodology)](https://huggingface.co/blog/qvac/botpsy#methodology) for the training recipe and data composition. Training code and training data are not part of this release; the datasets used are listed under [Licensing](#licensing).
|
| 102 |
+
|
| 103 |
+
## Usage
|
| 104 |
+
|
| 105 |
+
BotPsy keeps the Qwen3.5 architecture, so Hugging Face Transformers, vLLM and llama.cpp run it without custom code. Two settings matter.
|
| 106 |
+
|
| 107 |
+
- **Turn thinking on.** BotPsy was trained and evaluated in thinking mode. The chat template defaults to non-thinking, so pass `enable_thinking=True`.
|
| 108 |
+
- **Sampling.** Our evaluations used `temperature=0.3`, `top_p=0.95`, `top_k=20`, `presence_penalty=1.5` and up to 32,768 new tokens. `generation_config.json` sets the first three; presence penalty is available in vLLM and llama.cpp.
|
| 109 |
+
|
| 110 |
+
### Transformers
|
| 111 |
+
|
| 112 |
+
Requires a `transformers` release with Qwen3.5 support (tested with 5.19.0). Install `flash-linear-attention` and `causal-conv1d` for the fast Gated DeltaNet kernels; without them Transformers falls back to a slower reference implementation.
|
| 113 |
+
|
| 114 |
+
```python
|
| 115 |
+
import torch
|
| 116 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 117 |
+
|
| 118 |
+
model_id = "qvac/BotPsy-0.8B"
|
| 119 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 120 |
+
device = "cuda" if torch.cuda.is_available() else "cpu"
|
| 121 |
+
model = AutoModelForCausalLM.from_pretrained(model_id, dtype=torch.bfloat16).to(device)
|
| 122 |
+
|
| 123 |
+
tools = [{
|
| 124 |
+
"type": "function",
|
| 125 |
+
"function": {
|
| 126 |
+
"name": "create_event",
|
| 127 |
+
"description": "Add an event to the user's calendar",
|
| 128 |
+
"parameters": {
|
| 129 |
+
"type": "object",
|
| 130 |
+
"properties": {
|
| 131 |
+
"title": {"type": "string"},
|
| 132 |
+
"day": {"type": "string", "description": "Day of the week"},
|
| 133 |
+
"time": {"type": "string", "description": "Start time, 24h HH:MM"},
|
| 134 |
+
},
|
| 135 |
+
"required": ["title", "day", "time"],
|
| 136 |
+
},
|
| 137 |
+
},
|
| 138 |
+
}]
|
| 139 |
+
messages = [{"role": "user", "content": "Add the dentist on Friday at 3 pm."}]
|
| 140 |
+
|
| 141 |
+
inputs = tokenizer.apply_chat_template(
|
| 142 |
+
messages, tools=tools, add_generation_prompt=True, enable_thinking=True,
|
| 143 |
+
return_dict=True, return_tensors="pt",
|
| 144 |
+
).to(model.device)
|
| 145 |
+
out = model.generate(**inputs, max_new_tokens=4096) # sampling from generation_config.json
|
| 146 |
+
print(tokenizer.decode(out[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))
|
| 147 |
+
```
|
| 148 |
+
|
| 149 |
+
The answer ends with a tool call in the Qwen3.5 XML format:
|
| 150 |
+
|
| 151 |
+
```
|
| 152 |
+
<tool_call>
|
| 153 |
+
<function=create_event>
|
| 154 |
+
<parameter=title>
|
| 155 |
+
Dentist
|
| 156 |
+
</parameter>
|
| 157 |
+
...
|
| 158 |
+
</function>
|
| 159 |
+
</tool_call>
|
| 160 |
+
```
|
| 161 |
+
|
| 162 |
+
### vLLM (OpenAI-compatible server)
|
| 163 |
+
|
| 164 |
+
```bash
|
| 165 |
+
vllm serve qvac/BotPsy-0.8B --language-model-only \
|
| 166 |
+
--enable-auto-tool-choice --tool-call-parser qwen3_xml --reasoning-parser qwen3
|
| 167 |
+
```
|
| 168 |
+
|
| 169 |
+
```python
|
| 170 |
+
from openai import OpenAI
|
| 171 |
+
|
| 172 |
+
client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
|
| 173 |
+
resp = client.chat.completions.create(
|
| 174 |
+
model="qvac/BotPsy-0.8B",
|
| 175 |
+
messages=[{"role": "user", "content": "Add the dentist on Friday at 3 pm."}],
|
| 176 |
+
tools=tools, # same list as in the Transformers example
|
| 177 |
+
temperature=0.3, top_p=0.95, presence_penalty=1.5, max_tokens=8192,
|
| 178 |
+
extra_body={"top_k": 20, "chat_template_kwargs": {"enable_thinking": True}},
|
| 179 |
+
)
|
| 180 |
+
print(resp.choices[0].message.tool_calls)
|
| 181 |
+
```
|
| 182 |
+
|
| 183 |
+
### llama.cpp and the QVAC SDK
|
| 184 |
+
|
| 185 |
+
Use the GGUF files in [qvac/BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs); its model card has llama.cpp and QVAC SDK examples.
|
| 186 |
+
|
| 187 |
+
## Intended Use and Limitations
|
| 188 |
+
|
| 189 |
+
BotPsy has been developed to advance the state of the art and to support research and educational uses. Models developed based on our work could be suitable for tasks in domains such as device & system management (settings, files & documents, clocks & alarms), personal productivity & work (calendar & tasks, email, collaboration tools), communication (messaging), information retrieval & research (web search, weather, news), media & lifestyle (video, music, recipes & fitness, photos) and commerce & services (maps & travel, finance, shopping & delivery). Due to its small parameter count, it is best suited to tasks of low to medium difficulty.
|
| 190 |
+
|
| 191 |
+
BotPsy has been primarily trained and tested in English, which is the recommended language. It has also been evaluated on Multi-IF, which covers seven additional languages (Chinese, French, Hindi, Italian, Portuguese, Russian and Spanish): it performs well in most of them, but scores much lower in Hindi and Russian. BotPsy is a small language model, and it makes mistakes. It is not intended for safety-critical or high-stakes automated decisions, or for applications involving money, personal information, health and other sensitive topics.
|
| 192 |
+
|
| 193 |
+
## Related Resources
|
| 194 |
+
|
| 195 |
+
- [BotPsy blog post](https://huggingface.co/blog/qvac/botpsy): methodology, all benchmarks, app-level breakdown, inference efficiency
|
| 196 |
+
- [BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs): BF16, Q8_0 and Q4_K_M GGUF files for llama.cpp and the QVAC SDK
|
| 197 |
+
- [BotPsy collection](https://huggingface.co/collections/qvac/botpsy)
|
| 198 |
+
- [QVAC SDK](https://qvac.tether.io/dev/sdk/): on-device AI deployment framework
|
| 199 |
+
- [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B): base model
|
| 200 |
+
|
| 201 |
+
## Citation
|
| 202 |
+
|
| 203 |
+
```bibtex
|
| 204 |
+
@misc{botpsy2026,
|
| 205 |
+
title = {BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model},
|
| 206 |
+
author = {Tether Data, S.A. de C.V. d.b.a. Tether AI Research},
|
| 207 |
+
year = {2026},
|
| 208 |
+
howpublished = {Hugging Face blog},
|
| 209 |
+
url = {https://huggingface.co/blog/qvac/botpsy}
|
| 210 |
+
}
|
| 211 |
+
```
|
| 212 |
+
|
| 213 |
+
## Copyright Complaints
|
| 214 |
+
|
| 215 |
+
We will take appropriate actions in response to notice of copyright infringement. If you believe your work has been used or copied in a manner that infringes upon your intellectual property rights, please email [data-apps@tether.io](mailto:data-apps@tether.io) identifying and describing both the copyrighted work and alleged infringing content to file a notice of infringement.
|
| 216 |
+
|
| 217 |
+
## Licensing
|
| 218 |
+
|
| 219 |
+
This model which was trained as described in the [blog post](https://huggingface.co/blog/qvac/botpsy) is licensed by Tether Data, S.A. de C.V. under the [Apache 2.0](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md) license. As described in the blog post, this model is a version of the Qwen3.5-0.8B (Thinking) model ([https\://huggingface.co/Qwen/Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B)) which is licensed under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)).
|
| 220 |
+
|
| 221 |
+
As described in the blog post, the Qwen3.5-4B model ([https\://huggingface.co/Qwen/Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B)) which is licensed under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)) was put through three different reinforcement learning processes to create three versions of the model and each of those three versions of the model were then used as a teacher model.
|
| 222 |
+
|
| 223 |
+
Only subsets of some of the datasets listed below were used.
|
| 224 |
+
|
| 225 |
+
One version of the teacher model used the following datasets:
|
| 226 |
+
|
| 227 |
+
1) Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 228 |
+
2) Tool N1 dataset ([https\://github.com/NVlabs/Tool-N1](https://github.com/NVlabs/Tool-N1)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 229 |
+
3) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 230 |
+
4) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 231 |
+
5) xlam-irrelevance-7.5k dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 232 |
+
6) When2Call dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 233 |
+
7) ToolRL dataset ([https\://github.com/qiancheng0/ToolRL](https://github.com/qiancheng0/ToolRL)) made available under the Apache 2.0 license ([https\://github.com/qiancheng0/ToolRL?tab=Apache-2.0-1-ov-file](https://github.com/qiancheng0/ToolRL?tab=Apache-2.0-1-ov-file)); and
|
| 234 |
+
8) Nemotron-RL-Agentic-Function-Calling-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 235 |
+
|
| 236 |
+
One version of the teacher model used the following datasets:
|
| 237 |
+
|
| 238 |
+
1) Nemotron-RL-knowledge-mcqa dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa](https://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 239 |
+
2) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)).
|
| 240 |
+
|
| 241 |
+
One version of the teacher model used the following datasets:
|
| 242 |
+
|
| 243 |
+
1) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 244 |
+
2) Nemotron-RL-Instruction-Following-Calendar-v2 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 245 |
+
3) Nemotron-RL-instruction\_following-structured\_outputs dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following-structured\_outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following-structured_outputs)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 246 |
+
|
| 247 |
+
As described in the blog post, the model was fine tuned using the teacher models described above and the following datasets:
|
| 248 |
+
|
| 249 |
+
1) AReaL\_tau2 dataset ([https\://huggingface.co/datasets/inclusionAI/AReaL-tau2-data](https://huggingface.co/datasets/inclusionAI/AReaL-tau2-data)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 250 |
+
2) EnvFactory-SFT-FILTERED dataset ([https\://huggingface.co/datasets/LARK-Lab/EnvFactory-SFT-FILTERED](https://huggingface.co/datasets/LARK-Lab/EnvFactory-SFT-FILTERED)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 251 |
+
3) xlam-function-calling-60k dataset ([https\://huggingface.co/datasets/Salesforce/xlam-function-calling-60k](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 252 |
+
4) glaive-function-calling-v2 dataset ([https\://huggingface.co/datasets/glaiveai/glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 253 |
+
5) ToolACE dataset ([https\://huggingface.co/datasets/Team-ACE/ToolACE](https://huggingface.co/datasets/Team-ACE/ToolACE)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 254 |
+
6) When2call\_v2 dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://creativecommons.org/licenses/by/4.0/legalcode](https://creativecommons.org/licenses/by/4.0/legalcode));
|
| 255 |
+
7) Nemotron-SFT-Agentic-v2 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-SFT-Agentic-v2](https://huggingface.co/datasets/nvidia/Nemotron-SFT-Agentic-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md));
|
| 256 |
+
8) Infinity-Instruct dataset ([https\://huggingface.co/datasets/BAAI/Infinity-Instruct](https://huggingface.co/datasets/BAAI/Infinity-Instruct)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md));
|
| 257 |
+
9) toolbench\_v1 dataset ([https\://huggingface.co/datasets/tuandunghcmut/toolbench-v1](https://huggingface.co/datasets/tuandunghcmut/toolbench-v1)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 258 |
+
10) ToolMind dataset ([https\://huggingface.co/datasets/Nanbeige/ToolMind](https://huggingface.co/datasets/Nanbeige/ToolMind)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 259 |
+
11) Toucan-1.5M dataset (https\://huggingface.co/datasets/Agent-Ark/Toucan-1.5M) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 260 |
+
12) an unpublished synthetic dataset generated by Tether Data using Qwen3.5-9B ([https\://huggingface.co/Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B)) and Qwen3.6-27B ([https\://huggingface.co/Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B)), both of which are licensed under the Apache-2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)) and τ²-Bench made available under the MIT license ([https\://github.com/eligotts/tau2-bench?tab=License-1-ov-file](https://github.com/eligotts/tau2-bench?tab=License-1-ov-file));
|
| 261 |
+
13) xlam-irrelevance-7.5k dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md));
|
| 262 |
+
14) ultrachat\_200k dataset ([https\://huggingface.co/datasets/HuggingFaceH4/ultrachat\_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k)) made available under the MIT license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md));
|
| 263 |
+
15) smoltalk2 dataset ([https\://huggingface.co/datasets/HuggingFaceTB/smoltalk2](https://huggingface.co/datasets/HuggingFaceTB/smoltalk2)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 264 |
+
16) UltraData-SFT-2605 dataset ([https\://huggingface.co/datasets/openbmb/UltraData-SFT-2605](https://huggingface.co/datasets/openbmb/UltraData-SFT-2605)) made available under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/));
|
| 265 |
+
17) Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 266 |
+
18) Tool N1 dataset ([https\://github.com/NVlabs/Tool-N1](https://github.com/NVlabs/Tool-N1)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 267 |
+
19) IF\_multi\_constraints\_upto5 dataset ([https\://huggingface.co/datasets/allenai/IF\_multi\_constraints\_upto5](https://huggingface.co/datasets/allenai/IF_multi_constraints_upto5)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 268 |
+
20) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 269 |
+
21) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 270 |
+
22) xlam\_irrelevance-7.5K dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 271 |
+
23) Calendar-Scheduling-Dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 272 |
+
24) When2Call dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 273 |
+
25) ToolRL dataset ([https\://github.com/qiancheng0/ToolRL](https://github.com/qiancheng0/ToolRL)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 274 |
+
26) Nemotron-RL-Agentic-Function-Calling-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 275 |
+
27) DAPO-Math-17k dataset ([https\://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k)) dataset made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 276 |
+
28) Skywork-OR1-RL-Data dataset ([https\://huggingface.co/datasets/Skywork/Skywork-OR1-RL-Data](https://huggingface.co/datasets/Skywork/Skywork-OR1-RL-Data)) made accessible on Huggingface at the foregoing link;
|
| 277 |
+
29) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license (https\://opendatacommons.org/licenses/by/1-0/);
|
| 278 |
+
30) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a modified subset of the Nemotron-RL-knowledge-mcqa dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa](https://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 279 |
+
31) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-coding-competitive\_coding dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-coding-competitive\_coding](https://huggingface.co/datasets/nvidia/Nemotron-RL-coding-competitive_coding)) made available under the CC-BY-SA 4.0 (Creative Commons Share Attribution Alike 4.0 International) ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md));
|
| 280 |
+
32) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 281 |
+
33) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-agent-workplace\_assistant dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-agent-workplace\_assistant](https://huggingface.co/datasets/nvidia/Nemotron-RL-agent-workplace_assistant)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 282 |
+
34) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-instruction\_following-structured\_outputs dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following-structured\_outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following-structured_outputs)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 283 |
+
|
| 284 |
+
The full text of each license is reproduced in [ATTRIBUTIONS.md](https://huggingface.co/qvac/BotPsy-0.8B/blob/main/ATTRIBUTIONS.md).
|
botpsy-0.8b-mixed/assets/template-6d877b321d680a20-chat_template.jinja
ADDED
|
@@ -0,0 +1,157 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{%- set image_count = namespace(value=0) %}
|
| 2 |
+
{%- set video_count = namespace(value=0) %}
|
| 3 |
+
{%- macro render_content(content, do_vision_count, is_system_content=false) %}
|
| 4 |
+
{%- if content is string %}
|
| 5 |
+
{{- content }}
|
| 6 |
+
{%- elif content is iterable and content is not mapping %}
|
| 7 |
+
{%- for item in content %}
|
| 8 |
+
{%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
|
| 9 |
+
{%- if is_system_content %}
|
| 10 |
+
{{- raise_exception('System message cannot contain images.') }}
|
| 11 |
+
{%- endif %}
|
| 12 |
+
{%- if do_vision_count %}
|
| 13 |
+
{%- set image_count.value = image_count.value + 1 %}
|
| 14 |
+
{%- endif %}
|
| 15 |
+
{%- if add_vision_id %}
|
| 16 |
+
{{- 'Picture ' ~ image_count.value ~ ': ' }}
|
| 17 |
+
{%- endif %}
|
| 18 |
+
{{- '<|vision_start|><|image_pad|><|vision_end|>' }}
|
| 19 |
+
{%- elif 'video' in item or item.type == 'video' %}
|
| 20 |
+
{%- if is_system_content %}
|
| 21 |
+
{{- raise_exception('System message cannot contain videos.') }}
|
| 22 |
+
{%- endif %}
|
| 23 |
+
{%- if do_vision_count %}
|
| 24 |
+
{%- set video_count.value = video_count.value + 1 %}
|
| 25 |
+
{%- endif %}
|
| 26 |
+
{%- if add_vision_id %}
|
| 27 |
+
{{- 'Video ' ~ video_count.value ~ ': ' }}
|
| 28 |
+
{%- endif %}
|
| 29 |
+
{{- '<|vision_start|><|video_pad|><|vision_end|>' }}
|
| 30 |
+
{%- elif 'text' in item %}
|
| 31 |
+
{{- item.text }}
|
| 32 |
+
{%- else %}
|
| 33 |
+
{{- raise_exception('Unexpected item type in content.') }}
|
| 34 |
+
{%- endif %}
|
| 35 |
+
{%- endfor %}
|
| 36 |
+
{%- elif content is none or content is undefined %}
|
| 37 |
+
{{- '' }}
|
| 38 |
+
{%- else %}
|
| 39 |
+
{{- raise_exception('Unexpected content type.') }}
|
| 40 |
+
{%- endif %}
|
| 41 |
+
{%- endmacro %}
|
| 42 |
+
{%- if not messages %}
|
| 43 |
+
{{- raise_exception('No messages provided.') }}
|
| 44 |
+
{%- endif %}
|
| 45 |
+
{%- if tools and tools is iterable and tools is not mapping %}
|
| 46 |
+
{{- '<|im_start|>system\n' }}
|
| 47 |
+
{{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
|
| 48 |
+
{%- for tool in tools %}
|
| 49 |
+
{{- "\n" }}
|
| 50 |
+
{{- tool | tojson }}
|
| 51 |
+
{%- endfor %}
|
| 52 |
+
{{- "\n</tools>" }}
|
| 53 |
+
{{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
|
| 54 |
+
{%- if messages[0].role == 'system' %}
|
| 55 |
+
{%- set content = render_content(messages[0].content, false, true)|trim %}
|
| 56 |
+
{%- if content %}
|
| 57 |
+
{{- '\n\n' + content }}
|
| 58 |
+
{%- endif %}
|
| 59 |
+
{%- endif %}
|
| 60 |
+
{{- '<|im_end|>\n' }}
|
| 61 |
+
{%- else %}
|
| 62 |
+
{%- if messages[0].role == 'system' %}
|
| 63 |
+
{%- set content = render_content(messages[0].content, false, true)|trim %}
|
| 64 |
+
{{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
|
| 65 |
+
{%- endif %}
|
| 66 |
+
{%- endif %}
|
| 67 |
+
{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
|
| 68 |
+
{%- for message in messages[::-1] %}
|
| 69 |
+
{%- set index = (messages|length - 1) - loop.index0 %}
|
| 70 |
+
{%- if ns.multi_step_tool and message.role == "user" %}
|
| 71 |
+
{%- set content = render_content(message.content, false)|trim %}
|
| 72 |
+
{%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
|
| 73 |
+
{%- set ns.multi_step_tool = false %}
|
| 74 |
+
{%- set ns.last_query_index = index %}
|
| 75 |
+
{%- endif %}
|
| 76 |
+
{%- endif %}
|
| 77 |
+
{%- endfor %}
|
| 78 |
+
{%- if ns.multi_step_tool %}
|
| 79 |
+
{{- raise_exception('No user query found in messages.') }}
|
| 80 |
+
{%- endif %}
|
| 81 |
+
{%- for message in messages %}
|
| 82 |
+
{%- set content = render_content(message.content, true)|trim %}
|
| 83 |
+
{%- if message.role == "system" %}
|
| 84 |
+
{%- if not loop.first %}
|
| 85 |
+
{{- raise_exception('System message must be at the beginning.') }}
|
| 86 |
+
{%- endif %}
|
| 87 |
+
{%- elif message.role == "user" %}
|
| 88 |
+
{{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
|
| 89 |
+
{%- elif message.role == "assistant" %}
|
| 90 |
+
{%- set reasoning_content = '' %}
|
| 91 |
+
{%- if message.reasoning_content is string %}
|
| 92 |
+
{%- set reasoning_content = message.reasoning_content %}
|
| 93 |
+
{%- else %}
|
| 94 |
+
{%- if '</think>' in content %}
|
| 95 |
+
{%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
|
| 96 |
+
{%- set content = content.split('</think>')[-1].lstrip('\n') %}
|
| 97 |
+
{%- endif %}
|
| 98 |
+
{%- endif %}
|
| 99 |
+
{%- set reasoning_content = reasoning_content|trim %}
|
| 100 |
+
{{- '<|im_start|>' + message.role + '\n' -}}
|
| 101 |
+
{% generation %}
|
| 102 |
+
{%- if loop.index0 > ns.last_query_index %}
|
| 103 |
+
{{- '<think>\n' + reasoning_content + '\n</think>\n\n' + content -}}
|
| 104 |
+
{%- else %}
|
| 105 |
+
{{- content -}}
|
| 106 |
+
{%- endif %}
|
| 107 |
+
{%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
|
| 108 |
+
{%- for tool_call in message.tool_calls %}
|
| 109 |
+
{%- if tool_call.function is defined %}
|
| 110 |
+
{%- set tool_call = tool_call.function %}
|
| 111 |
+
{%- endif %}
|
| 112 |
+
{%- if loop.first %}
|
| 113 |
+
{%- if content|trim %}
|
| 114 |
+
{{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 115 |
+
{%- else %}
|
| 116 |
+
{{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 117 |
+
{%- endif %}
|
| 118 |
+
{%- else %}
|
| 119 |
+
{{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 120 |
+
{%- endif %}
|
| 121 |
+
{%- if tool_call.arguments is defined %}
|
| 122 |
+
{%- for args_name, args_value in tool_call.arguments|items %}
|
| 123 |
+
{{- '<parameter=' + args_name + '>\n' }}
|
| 124 |
+
{%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
|
| 125 |
+
{{- args_value }}
|
| 126 |
+
{{- '\n</parameter>\n' }}
|
| 127 |
+
{%- endfor %}
|
| 128 |
+
{%- endif %}
|
| 129 |
+
{{- '</function>\n</tool_call>' }}
|
| 130 |
+
{%- endfor %}
|
| 131 |
+
{%- endif %}
|
| 132 |
+
{{- '<|im_end|>\n' }}
|
| 133 |
+
{%- endgeneration %}
|
| 134 |
+
{%- elif message.role == "tool" %}
|
| 135 |
+
{%- if loop.previtem and loop.previtem.role != "tool" %}
|
| 136 |
+
{{- '<|im_start|>user' }}
|
| 137 |
+
{%- endif %}
|
| 138 |
+
{{- '\n<tool_response>\n' }}
|
| 139 |
+
{{- content }}
|
| 140 |
+
{{- '\n</tool_response>' }}
|
| 141 |
+
{%- if not loop.last and loop.nextitem.role != "tool" %}
|
| 142 |
+
{{- '<|im_end|>\n' }}
|
| 143 |
+
{%- elif loop.last %}
|
| 144 |
+
{{- '<|im_end|>\n' }}
|
| 145 |
+
{%- endif %}
|
| 146 |
+
{%- else %}
|
| 147 |
+
{{- raise_exception('Unexpected message role.') }}
|
| 148 |
+
{%- endif %}
|
| 149 |
+
{%- endfor %}
|
| 150 |
+
{%- if add_generation_prompt %}
|
| 151 |
+
{{- '<|im_start|>assistant\n' }}
|
| 152 |
+
{%- if enable_thinking is defined and enable_thinking is true %}
|
| 153 |
+
{{- '<think>\n' }}
|
| 154 |
+
{%- else %}
|
| 155 |
+
{{- '<think>\n\n</think>\n\n' }}
|
| 156 |
+
{%- endif %}
|
| 157 |
+
{%- endif %}
|
botpsy-0.8b-mixed/assets/tokenizer-06b9509352d2af50-tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523
|
| 3 |
+
size 19989325
|
botpsy-0.8b-mixed/conversion-report.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0c3d0a10165d5d8d82363b79b282cc77f013b441f6dce27e627f87047809e43
|
| 3 |
+
size 38842
|
botpsy-0.8b-mixed/manifest.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3a2a322b921fcba7af085cb1dbaba4fc34991dff50b4cbfcde1a524fcdb87b63
|
| 3 |
+
size 233867
|
botpsy-0.8b-mixed/shard-000.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:54e92273feb9a249dc906d64dcdbc0d24c5fab0ad4783ff7ac3ab93aa5cc723e
|
| 3 |
+
size 67108176
|
botpsy-0.8b-mixed/shard-001.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cfcaac5d0918bf64c2d8d3efe7128460523f538b8f4f41f167e77d7d0be68d9e
|
| 3 |
+
size 67108176
|
botpsy-0.8b-mixed/shard-002.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:953dacb591bc4a4c213783ed94262660a3c38027cf63f85bfbbbc927901c35e9
|
| 3 |
+
size 67108176
|
botpsy-0.8b-mixed/shard-003.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7b48ed571cb9025961d290693f54a0185fafa0b4a73f4bce124c05cba0e3ee1a
|
| 3 |
+
size 65616384
|
botpsy-0.8b-mixed/shard-004.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:02fb84b32785c4c0f0ed8ed99a66de00b9c247d063a7c29de377e6b92ad9637c
|
| 3 |
+
size 62705920
|
botpsy-0.8b-mixed/shard-005.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8564084ffa300f0f5c3421d75831fde8c4b5237a33575b67cde6cd7e7382ea8c
|
| 3 |
+
size 65516544
|
botpsy-0.8b-mixed/shard-006.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:848246357222a1d6b7c975b70a2dbbf0ca5137b00d532f559ab799e1cef84858
|
| 3 |
+
size 66098176
|
botpsy-0.8b-mixed/shard-007.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9594e0d6b879d22cabafffce4e6f13ea04a209baa3d9b471debce77e93ee607c
|
| 3 |
+
size 66679680
|
botpsy-0.8b-mixed/shard-008.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:96ea429490196036fde638818a8cae38eeb632046daf1673b6ad227ed0faf200
|
| 3 |
+
size 14968832
|
botpsy-0.8b-q4_k_m/assets/attribution-dcc5f18a858ad472-ATTRIBUTIONS.md
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
botpsy-0.8b-q4_k_m/assets/config-1dd43fe49e93b477-config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1dd43fe49e93b4778f67be093bf1d03b3a6cadf487ff5585ab7ffb2b34631543
|
| 3 |
+
size 2701
|
botpsy-0.8b-q4_k_m/assets/license-c71d239df91726fc-LICENSE
ADDED
|
@@ -0,0 +1,201 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Apache License
|
| 2 |
+
Version 2.0, January 2004
|
| 3 |
+
http://www.apache.org/licenses/
|
| 4 |
+
|
| 5 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 6 |
+
|
| 7 |
+
1. Definitions.
|
| 8 |
+
|
| 9 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 10 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 11 |
+
|
| 12 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 13 |
+
the copyright owner that is granting the License.
|
| 14 |
+
|
| 15 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 16 |
+
other entities that control, are controlled by, or are under common
|
| 17 |
+
control with that entity. For the purposes of this definition,
|
| 18 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 19 |
+
direction or management of such entity, whether by contract or
|
| 20 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 21 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 22 |
+
|
| 23 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 24 |
+
exercising permissions granted by this License.
|
| 25 |
+
|
| 26 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 27 |
+
including but not limited to software source code, documentation
|
| 28 |
+
source, and configuration files.
|
| 29 |
+
|
| 30 |
+
"Object" form shall mean any form resulting from mechanical
|
| 31 |
+
transformation or translation of a Source form, including but
|
| 32 |
+
not limited to compiled object code, generated documentation,
|
| 33 |
+
and conversions to other media types.
|
| 34 |
+
|
| 35 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 36 |
+
Object form, made available under the License, as indicated by a
|
| 37 |
+
copyright notice that is included in or attached to the work
|
| 38 |
+
(an example is provided in the Appendix below).
|
| 39 |
+
|
| 40 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 41 |
+
form, that is based on (or derived from) the Work and for which the
|
| 42 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 43 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 44 |
+
of this License, Derivative Works shall not include works that remain
|
| 45 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 46 |
+
the Work and Derivative Works thereof.
|
| 47 |
+
|
| 48 |
+
"Contribution" shall mean any work of authorship, including
|
| 49 |
+
the original version of the Work and any modifications or additions
|
| 50 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 51 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 52 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 53 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 54 |
+
means any form of electronic, verbal, or written communication sent
|
| 55 |
+
to the Licensor or its representatives, including but not limited to
|
| 56 |
+
communication on electronic mailing lists, source code control systems,
|
| 57 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 58 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 59 |
+
excluding communication that is conspicuously marked or otherwise
|
| 60 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 61 |
+
|
| 62 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 63 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 64 |
+
subsequently incorporated within the Work.
|
| 65 |
+
|
| 66 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 67 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 68 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 69 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 70 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 71 |
+
Work and such Derivative Works in Source or Object form.
|
| 72 |
+
|
| 73 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 74 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 75 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 76 |
+
(except as stated in this section) patent license to make, have made,
|
| 77 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 78 |
+
where such license applies only to those patent claims licensable
|
| 79 |
+
by such Contributor that are necessarily infringed by their
|
| 80 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 81 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 82 |
+
institute patent litigation against any entity (including a
|
| 83 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 84 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 85 |
+
or contributory patent infringement, then any patent licenses
|
| 86 |
+
granted to You under this License for that Work shall terminate
|
| 87 |
+
as of the date such litigation is filed.
|
| 88 |
+
|
| 89 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 90 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 91 |
+
modifications, and in Source or Object form, provided that You
|
| 92 |
+
meet the following conditions:
|
| 93 |
+
|
| 94 |
+
(a) You must give any other recipients of the Work or
|
| 95 |
+
Derivative Works a copy of this License; and
|
| 96 |
+
|
| 97 |
+
(b) You must cause any modified files to carry prominent notices
|
| 98 |
+
stating that You changed the files; and
|
| 99 |
+
|
| 100 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 101 |
+
that You distribute, all copyright, patent, trademark, and
|
| 102 |
+
attribution notices from the Source form of the Work,
|
| 103 |
+
excluding those notices that do not pertain to any part of
|
| 104 |
+
the Derivative Works; and
|
| 105 |
+
|
| 106 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 107 |
+
distribution, then any Derivative Works that You distribute must
|
| 108 |
+
include a readable copy of the attribution notices contained
|
| 109 |
+
within such NOTICE file, excluding those notices that do not
|
| 110 |
+
pertain to any part of the Derivative Works, in at least one
|
| 111 |
+
of the following places: within a NOTICE text file distributed
|
| 112 |
+
as part of the Derivative Works; within the Source form or
|
| 113 |
+
documentation, if provided along with the Derivative Works; or,
|
| 114 |
+
within a display generated by the Derivative Works, if and
|
| 115 |
+
wherever such third-party notices normally appear. The contents
|
| 116 |
+
of the NOTICE file are for informational purposes only and
|
| 117 |
+
do not modify the License. You may add Your own attribution
|
| 118 |
+
notices within Derivative Works that You distribute, alongside
|
| 119 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 120 |
+
that such additional attribution notices cannot be construed
|
| 121 |
+
as modifying the License.
|
| 122 |
+
|
| 123 |
+
You may add Your own copyright statement to Your modifications and
|
| 124 |
+
may provide additional or different license terms and conditions
|
| 125 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 126 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 127 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 128 |
+
the conditions stated in this License.
|
| 129 |
+
|
| 130 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 131 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 132 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 133 |
+
this License, without any additional terms or conditions.
|
| 134 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 135 |
+
the terms of any separate license agreement you may have executed
|
| 136 |
+
with Licensor regarding such Contributions.
|
| 137 |
+
|
| 138 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 139 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 140 |
+
except as required for reasonable and customary use in describing the
|
| 141 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 142 |
+
|
| 143 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 144 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 145 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 146 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 147 |
+
implied, including, without limitation, any warranties or conditions
|
| 148 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 149 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 150 |
+
appropriateness of using or redistributing the Work and assume any
|
| 151 |
+
risks associated with Your exercise of permissions under this License.
|
| 152 |
+
|
| 153 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 154 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 155 |
+
unless required by applicable law (such as deliberate and grossly
|
| 156 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 157 |
+
liable to You for damages, including any direct, indirect, special,
|
| 158 |
+
incidental, or consequential damages of any character arising as a
|
| 159 |
+
result of this License or out of the use or inability to use the
|
| 160 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 161 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 162 |
+
other commercial damages or losses), even if such Contributor
|
| 163 |
+
has been advised of the possibility of such damages.
|
| 164 |
+
|
| 165 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 166 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 167 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 168 |
+
or other liability obligations and/or rights consistent with this
|
| 169 |
+
License. However, in accepting such obligations, You may act only
|
| 170 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 171 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 172 |
+
defend, and hold each Contributor harmless for any liability
|
| 173 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 174 |
+
of your accepting any such warranty or additional liability.
|
| 175 |
+
|
| 176 |
+
END OF TERMS AND CONDITIONS
|
| 177 |
+
|
| 178 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 179 |
+
|
| 180 |
+
To apply the Apache License to your work, attach the following
|
| 181 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 182 |
+
replaced with your own identifying information. (Don't include
|
| 183 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 184 |
+
comment syntax for the file format. We also recommend that a
|
| 185 |
+
file or class name and description of purpose be included on the
|
| 186 |
+
same "printed page" as the copyright notice for easier
|
| 187 |
+
identification within third-party archives.
|
| 188 |
+
|
| 189 |
+
Copyright [yyyy] [name of copyright owner]
|
| 190 |
+
|
| 191 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 192 |
+
you may not use this file except in compliance with the License.
|
| 193 |
+
You may obtain a copy of the License at
|
| 194 |
+
|
| 195 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 196 |
+
|
| 197 |
+
Unless required by applicable law or agreed to in writing, software
|
| 198 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 199 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 200 |
+
See the License for the specific language governing permissions and
|
| 201 |
+
limitations under the License.
|
botpsy-0.8b-q4_k_m/assets/processor-d89ef49ce9cd37fb-processor_config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d89ef49ce9cd37fbf510158e13c1ef063d9286411c1ec9049932dbe0487143b1
|
| 3 |
+
size 1191
|
botpsy-0.8b-q4_k_m/assets/readme-959811cca18e73a6-README.md
ADDED
|
@@ -0,0 +1,284 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
license_link: https://huggingface.co/qvac/BotPsy-0.8B/blob/main/LICENSE
|
| 4 |
+
language:
|
| 5 |
+
- en
|
| 6 |
+
library_name: transformers
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
+
base_model:
|
| 9 |
+
- Qwen/Qwen3.5-0.8B
|
| 10 |
+
base_model_relation: finetune
|
| 11 |
+
tags:
|
| 12 |
+
- tool-calling
|
| 13 |
+
- function-calling
|
| 14 |
+
- agent
|
| 15 |
+
- agentic
|
| 16 |
+
- on-device
|
| 17 |
+
- edge
|
| 18 |
+
- qwen3_5
|
| 19 |
+
- tether-ai
|
| 20 |
+
- qvac
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
# BotPsy-0.8B
|
| 24 |
+
|
| 25 |
+
**BotPsy-0.8B** is a 0.8B-parameter model designed for function calling and agentic workflows, built on top of [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) and suitable for on-device deployment. BotPsy is a "personal assistant" that uses tools to perform a variety of simple tasks for the user, in domains such as web search & research, travel & lifestyle, commerce & finance, business & customer operations, device & vehicle control, files & documents, calendar, and email & messaging. Due to its small parameter count, it is best suited to tasks of low to medium difficulty. BotPsy achieves state-of-the-art (SOTA) tool-use and agentic performance for its size, outperforming every model of up to 1.2B parameters that we tested. As a small model, BotPsy still makes mistakes and is best suited to tasks of low to medium difficulty; please read the [Intended Use and Limitations](#intended-use-and-limitations) section for more information.
|
| 26 |
+
|
| 27 |
+
This repository holds the BF16 weights in Hugging Face safetensors format. GGUF files (BF16, Q8_0 and Q4_K_M) for llama.cpp and the QVAC SDK are in [qvac/BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs). The full write-up, with every benchmark and the training method, is the [BotPsy blog post](https://huggingface.co/blog/qvac/botpsy).
|
| 28 |
+
|
| 29 |
+
| | |
|
| 30 |
+
|:---|:---|
|
| 31 |
+
| **Developed by** | [Tether AI Research](https://tether.io/)<sup>*</sup> |
|
| 32 |
+
| **Model type** | Causal language model for tool calling (Qwen3.5 architecture: hybrid Gated DeltaNet + gated attention), used text-only |
|
| 33 |
+
| **Parameters** | 0.8B |
|
| 34 |
+
| **Base model** | [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) |
|
| 35 |
+
| **Reasoning** | Thinks before it answers (thinking mode, `enable_thinking=True`) |
|
| 36 |
+
| **Language** | English (recommended) |
|
| 37 |
+
| **Precision** | BF16 (this repository); BF16, Q8_0 and Q4_K_M GGUF in [BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs) |
|
| 38 |
+
| **License** | [Apache 2.0](https://huggingface.co/qvac/BotPsy-0.8B/blob/main/LICENSE) |
|
| 39 |
+
| **Blog post** | [BotPsy on Hugging Face](https://huggingface.co/blog/qvac/botpsy) |
|
| 40 |
+
| **Collection** | [BotPsy](https://huggingface.co/collections/qvac/botpsy) |
|
| 41 |
+
|
| 42 |
+
<sup>*</sup> References to Tether AI Research are references to Tether Data, S.A. de C.V.
|
| 43 |
+
|
| 44 |
+
## Key Highlights
|
| 45 |
+
|
| 46 |
+
### Benchmark results
|
| 47 |
+
- **Twice the performance of its base model:** BotPsy roughly doubles the agentic capability of Qwen3.5-0.8B-Think on key benchmarks: BFCL v4 rises from 23.4 to 44.0, ACEBench from 30.1 to 58.7, and τ-bench from 23.2 to 51.5 (mean of the retail, telecom and banking subsets).
|
| 48 |
+
- **Best agent in its category:** BotPsy outperforms leading models in the ≤1.2B-parameter weight class (Qwen3.5-0.8B-Think, LFM2.5-1.2B-Think, MiniCPM5-1B-Think) on all six tool-use and agentic benchmarks: BFCL v4, ACEBench, τ-bench, ToolSandbox, Claw-Eval and BrowseComp-Plus.
|
| 49 |
+
- **Outperforms its larger sibling:** BotPsy has the highest score of all models tested on five of the six benchmarks, beating Qwen3.5-2B-Think, a model 2.5× its size, on BFCL v4 (44.0 vs 37.7), ACEBench (58.7 vs 55.4), τ-bench (51.5 vs 46.5), ToolSandbox (64.6 vs 41.2) and BrowseComp-Plus (4.5 vs 2.8). Only on Claw-Eval does Qwen3.5-2B-Think lead (48.9 vs 46.5).
|
| 50 |
+
|
| 51 |
+
### Model capabilities
|
| 52 |
+
- **More reliable in multi-turn workflows:** On τ²-bench, where the agent must hold a long customer conversation, follow a strict policy, and act on the customer's behalf, it scores 82.5 in telecom, ahead of Qwen3.5-2B-Think (69.3). On BFCL v4's multi-turn tasks, it rises from 7.5 to 46.1 over its base, nearly double Qwen3.5-2B-Think (23.8). Grouped by application, its multi-step scores lead all models tested in commerce and services (58.3 vs 47.4 for the next best, Qwen3.5-2B-Think) and in device and system management (46.1 vs 31.9).
|
| 53 |
+
- **Knows when (not) to call tools:** An agent that acts must also know when not to act. On BFCL v4's hallucination tests, which check that the model declines when no appropriate tool exists, BotPsy scores 86.1, the highest of all models tested. On ACEBench's special cases, where the request is incomplete, contains wrong parameters, or cannot be served by the given tools, it scores 51.3, up from 13.7 for its base model.
|
| 54 |
+
- **Follows instructions while preserving knowledge:** BotPsy specializes in tool use while preserving general skills. Instruction following improves sharply, with IFEval rising from 59.7 to 90.8 and IFBench from 22.0 to 55.9, the highest IFBench score of all models tested. General knowledge also improves, with GPQA Diamond rising from 33.2 to 38.1 and MMLU-Pro from 41.6 to 48.9. On all four benchmarks, BotPsy outperforms every other model of 1.2B parameters or fewer that we tested.
|
| 55 |
+
|
| 56 |
+
## Benchmark Results
|
| 57 |
+
|
| 58 |
+
All five models were evaluated in thinking mode with one shared evaluation harness. BotPsy was served from these BF16 weights with vLLM. Best score per row in **bold**, second best <u>underlined</u>; multipliers give parameter count relative to BotPsy-0.8B.
|
| 59 |
+
|
| 60 |
+
| Benchmark | **BotPsy-0.8B**<br><sub>ours</sub> | Qwen3.5-0.8B-Think<br><sub>base · 1×</sub> | Qwen3.5-2B-Think<br><sub>2.5×</sub> | LFM2.5-1.2B-Think<br><sub>1.5×</sub> | MiniCPM5-1B-Think<br><sub>1.25×</sub> |
|
| 61 |
+
| :--- | :---: | :---: | :---: | :---: | :---: |
|
| 62 |
+
| ***Tool use & agents*** | | | | | |
|
| 63 |
+
| BFCL v4¹ | **44.0** | 23.4 | <u>37.7</u> | 28.1 | 22.8 |
|
| 64 |
+
| ACEBench² | **58.7** | 30.1 | <u>55.4</u> | 39.4 | 24.5 |
|
| 65 |
+
| τ-bench³ | **51.5** | 23.2 | <u>46.5</u> | 6.5 | 28.8 |
|
| 66 |
+
| Claw-Eval⁴ | <u>46.5</u> | 39.3 | **48.9** | 31.6 | 31.0 |
|
| 67 |
+
| BrowseComp-Plus⁵ | **4.5** | 1.9 | <u>2.8</u> | 0.2 | 0.8 |
|
| 68 |
+
| ToolSandbox⁶ | **64.6** | 30.5 | 41.2 | <u>45.7</u> | 28.1 |
|
| 69 |
+
| *Average* | ***45.0*** | *24.7* | *<u>38.8</u>* | *25.3* | *22.7* |
|
| 70 |
+
| ***Knowledge*** | | | | | |
|
| 71 |
+
| GPQA Diamond⁷ | <u>38.1</u> | 33.2 | **59.9** | 35.0 | 15.8 |
|
| 72 |
+
| MMLU-Pro⁸ | <u>48.9</u> | 41.6 | **65.5** | 39.4 | 40.0 |
|
| 73 |
+
| ***Instruction following*** | | | | | |
|
| 74 |
+
| IFEval⁹ | **90.8** | 59.7 | 80.0 | <u>85.6</u> | 78.4 |
|
| 75 |
+
| IFBench⁹ | **55.9** | 22.0 | <u>40.9</u> | 33.9 | 40.6 |
|
| 76 |
+
| Multi-IF¹⁰ | <u>67.2</u> | 43.2 | 66.9 | **68.2** | 53.4 |
|
| 77 |
+
|
| 78 |
+
<details>
|
| 79 |
+
<summary>Evaluation footnotes</summary>
|
| 80 |
+
|
| 81 |
+
- All scores are percentages (higher is better).
|
| 82 |
+
- All models were evaluated in thinking (reasoning) mode.
|
| 83 |
+
- All benchmarks that use an external API were run on **November 3, 2026**.
|
| 84 |
+
- ¹ BFCL v4: overall score calculated using the official weighted formula (40% Agentic, 30% Multi-Turn, 10% Live, 10% Non-Live, and 10% Hallucination), averaged over 3 runs.
|
| 85 |
+
- ² ACEBench: overall accuracy. All models were evaluated in function-calling (FC) mode; mean of 2 runs.
|
| 86 |
+
- ³ τ-bench: average of τ²-bench (retail, telecom) and τ³-bench (banking), excluding airline; mean of 3 runs.
|
| 87 |
+
- ⁴ Claw-Eval: official average task score, where each task scores safety × (0.8 × completion + 0.2 × robustness); mean of 3 runs.
|
| 88 |
+
- ⁵ BrowseComp-Plus: accuracy, with a maximum of 30 steps for all models.
|
| 89 |
+
- ⁶ ToolSandbox: mean similarity score over 8 settings.
|
| 90 |
+
- ⁷ GPQA Diamond: accuracy over all 198 questions, mean of 3 runs, thinking enabled.
|
| 91 |
+
- ⁸ MMLU-Pro: accuracy.
|
| 92 |
+
- ⁹ IFEval, IFBench: prompt-level strict accuracy.
|
| 93 |
+
- ¹⁰ Multi-IF: average of 3 runs.
|
| 94 |
+
|
| 95 |
+
</details>
|
| 96 |
+
|
| 97 |
+
BotPsy's weaker spots are open-ended search and a few areas where Qwen3.5-2B-Think still leads: BrowseComp-Plus deep research (4.5, the best of the five but low in absolute terms), BFCL web search (14.0) and memory (16.3), Claw-Eval, and ACEBench's special cases. On τ³-banking no model gets above 5. Knowledge still scales mainly with parameter count, so BotPsy is designed to call tools for facts it does not know, not to serve as a knowledge model. See the [blog post](https://huggingface.co/blog/qvac/botpsy) for the multi-turn, app-level and efficiency analyses.
|
| 98 |
+
|
| 99 |
+
## Training
|
| 100 |
+
|
| 101 |
+
BotPsy is based on Qwen3.5-0.8B and is post-trained in four stages: supervised fine-tuning, multi-teacher on-policy distillation, and two rounds of reinforcement learning. See the [blog post (Methodology)](https://huggingface.co/blog/qvac/botpsy#methodology) for the training recipe and data composition. Training code and training data are not part of this release; the datasets used are listed under [Licensing](#licensing).
|
| 102 |
+
|
| 103 |
+
## Usage
|
| 104 |
+
|
| 105 |
+
BotPsy keeps the Qwen3.5 architecture, so Hugging Face Transformers, vLLM and llama.cpp run it without custom code. Two settings matter.
|
| 106 |
+
|
| 107 |
+
- **Turn thinking on.** BotPsy was trained and evaluated in thinking mode. The chat template defaults to non-thinking, so pass `enable_thinking=True`.
|
| 108 |
+
- **Sampling.** Our evaluations used `temperature=0.3`, `top_p=0.95`, `top_k=20`, `presence_penalty=1.5` and up to 32,768 new tokens. `generation_config.json` sets the first three; presence penalty is available in vLLM and llama.cpp.
|
| 109 |
+
|
| 110 |
+
### Transformers
|
| 111 |
+
|
| 112 |
+
Requires a `transformers` release with Qwen3.5 support (tested with 5.19.0). Install `flash-linear-attention` and `causal-conv1d` for the fast Gated DeltaNet kernels; without them Transformers falls back to a slower reference implementation.
|
| 113 |
+
|
| 114 |
+
```python
|
| 115 |
+
import torch
|
| 116 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 117 |
+
|
| 118 |
+
model_id = "qvac/BotPsy-0.8B"
|
| 119 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 120 |
+
device = "cuda" if torch.cuda.is_available() else "cpu"
|
| 121 |
+
model = AutoModelForCausalLM.from_pretrained(model_id, dtype=torch.bfloat16).to(device)
|
| 122 |
+
|
| 123 |
+
tools = [{
|
| 124 |
+
"type": "function",
|
| 125 |
+
"function": {
|
| 126 |
+
"name": "create_event",
|
| 127 |
+
"description": "Add an event to the user's calendar",
|
| 128 |
+
"parameters": {
|
| 129 |
+
"type": "object",
|
| 130 |
+
"properties": {
|
| 131 |
+
"title": {"type": "string"},
|
| 132 |
+
"day": {"type": "string", "description": "Day of the week"},
|
| 133 |
+
"time": {"type": "string", "description": "Start time, 24h HH:MM"},
|
| 134 |
+
},
|
| 135 |
+
"required": ["title", "day", "time"],
|
| 136 |
+
},
|
| 137 |
+
},
|
| 138 |
+
}]
|
| 139 |
+
messages = [{"role": "user", "content": "Add the dentist on Friday at 3 pm."}]
|
| 140 |
+
|
| 141 |
+
inputs = tokenizer.apply_chat_template(
|
| 142 |
+
messages, tools=tools, add_generation_prompt=True, enable_thinking=True,
|
| 143 |
+
return_dict=True, return_tensors="pt",
|
| 144 |
+
).to(model.device)
|
| 145 |
+
out = model.generate(**inputs, max_new_tokens=4096) # sampling from generation_config.json
|
| 146 |
+
print(tokenizer.decode(out[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))
|
| 147 |
+
```
|
| 148 |
+
|
| 149 |
+
The answer ends with a tool call in the Qwen3.5 XML format:
|
| 150 |
+
|
| 151 |
+
```
|
| 152 |
+
<tool_call>
|
| 153 |
+
<function=create_event>
|
| 154 |
+
<parameter=title>
|
| 155 |
+
Dentist
|
| 156 |
+
</parameter>
|
| 157 |
+
...
|
| 158 |
+
</function>
|
| 159 |
+
</tool_call>
|
| 160 |
+
```
|
| 161 |
+
|
| 162 |
+
### vLLM (OpenAI-compatible server)
|
| 163 |
+
|
| 164 |
+
```bash
|
| 165 |
+
vllm serve qvac/BotPsy-0.8B --language-model-only \
|
| 166 |
+
--enable-auto-tool-choice --tool-call-parser qwen3_xml --reasoning-parser qwen3
|
| 167 |
+
```
|
| 168 |
+
|
| 169 |
+
```python
|
| 170 |
+
from openai import OpenAI
|
| 171 |
+
|
| 172 |
+
client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
|
| 173 |
+
resp = client.chat.completions.create(
|
| 174 |
+
model="qvac/BotPsy-0.8B",
|
| 175 |
+
messages=[{"role": "user", "content": "Add the dentist on Friday at 3 pm."}],
|
| 176 |
+
tools=tools, # same list as in the Transformers example
|
| 177 |
+
temperature=0.3, top_p=0.95, presence_penalty=1.5, max_tokens=8192,
|
| 178 |
+
extra_body={"top_k": 20, "chat_template_kwargs": {"enable_thinking": True}},
|
| 179 |
+
)
|
| 180 |
+
print(resp.choices[0].message.tool_calls)
|
| 181 |
+
```
|
| 182 |
+
|
| 183 |
+
### llama.cpp and the QVAC SDK
|
| 184 |
+
|
| 185 |
+
Use the GGUF files in [qvac/BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs); its model card has llama.cpp and QVAC SDK examples.
|
| 186 |
+
|
| 187 |
+
## Intended Use and Limitations
|
| 188 |
+
|
| 189 |
+
BotPsy has been developed to advance the state of the art and to support research and educational uses. Models developed based on our work could be suitable for tasks in domains such as device & system management (settings, files & documents, clocks & alarms), personal productivity & work (calendar & tasks, email, collaboration tools), communication (messaging), information retrieval & research (web search, weather, news), media & lifestyle (video, music, recipes & fitness, photos) and commerce & services (maps & travel, finance, shopping & delivery). Due to its small parameter count, it is best suited to tasks of low to medium difficulty.
|
| 190 |
+
|
| 191 |
+
BotPsy has been primarily trained and tested in English, which is the recommended language. It has also been evaluated on Multi-IF, which covers seven additional languages (Chinese, French, Hindi, Italian, Portuguese, Russian and Spanish): it performs well in most of them, but scores much lower in Hindi and Russian. BotPsy is a small language model, and it makes mistakes. It is not intended for safety-critical or high-stakes automated decisions, or for applications involving money, personal information, health and other sensitive topics.
|
| 192 |
+
|
| 193 |
+
## Related Resources
|
| 194 |
+
|
| 195 |
+
- [BotPsy blog post](https://huggingface.co/blog/qvac/botpsy): methodology, all benchmarks, app-level breakdown, inference efficiency
|
| 196 |
+
- [BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs): BF16, Q8_0 and Q4_K_M GGUF files for llama.cpp and the QVAC SDK
|
| 197 |
+
- [BotPsy collection](https://huggingface.co/collections/qvac/botpsy)
|
| 198 |
+
- [QVAC SDK](https://qvac.tether.io/dev/sdk/): on-device AI deployment framework
|
| 199 |
+
- [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B): base model
|
| 200 |
+
|
| 201 |
+
## Citation
|
| 202 |
+
|
| 203 |
+
```bibtex
|
| 204 |
+
@misc{botpsy2026,
|
| 205 |
+
title = {BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model},
|
| 206 |
+
author = {Tether Data, S.A. de C.V. d.b.a. Tether AI Research},
|
| 207 |
+
year = {2026},
|
| 208 |
+
howpublished = {Hugging Face blog},
|
| 209 |
+
url = {https://huggingface.co/blog/qvac/botpsy}
|
| 210 |
+
}
|
| 211 |
+
```
|
| 212 |
+
|
| 213 |
+
## Copyright Complaints
|
| 214 |
+
|
| 215 |
+
We will take appropriate actions in response to notice of copyright infringement. If you believe your work has been used or copied in a manner that infringes upon your intellectual property rights, please email [data-apps@tether.io](mailto:data-apps@tether.io) identifying and describing both the copyrighted work and alleged infringing content to file a notice of infringement.
|
| 216 |
+
|
| 217 |
+
## Licensing
|
| 218 |
+
|
| 219 |
+
This model which was trained as described in the [blog post](https://huggingface.co/blog/qvac/botpsy) is licensed by Tether Data, S.A. de C.V. under the [Apache 2.0](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md) license. As described in the blog post, this model is a version of the Qwen3.5-0.8B (Thinking) model ([https\://huggingface.co/Qwen/Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B)) which is licensed under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)).
|
| 220 |
+
|
| 221 |
+
As described in the blog post, the Qwen3.5-4B model ([https\://huggingface.co/Qwen/Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B)) which is licensed under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)) was put through three different reinforcement learning processes to create three versions of the model and each of those three versions of the model were then used as a teacher model.
|
| 222 |
+
|
| 223 |
+
Only subsets of some of the datasets listed below were used.
|
| 224 |
+
|
| 225 |
+
One version of the teacher model used the following datasets:
|
| 226 |
+
|
| 227 |
+
1) Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 228 |
+
2) Tool N1 dataset ([https\://github.com/NVlabs/Tool-N1](https://github.com/NVlabs/Tool-N1)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 229 |
+
3) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 230 |
+
4) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 231 |
+
5) xlam-irrelevance-7.5k dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 232 |
+
6) When2Call dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 233 |
+
7) ToolRL dataset ([https\://github.com/qiancheng0/ToolRL](https://github.com/qiancheng0/ToolRL)) made available under the Apache 2.0 license ([https\://github.com/qiancheng0/ToolRL?tab=Apache-2.0-1-ov-file](https://github.com/qiancheng0/ToolRL?tab=Apache-2.0-1-ov-file)); and
|
| 234 |
+
8) Nemotron-RL-Agentic-Function-Calling-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 235 |
+
|
| 236 |
+
One version of the teacher model used the following datasets:
|
| 237 |
+
|
| 238 |
+
1) Nemotron-RL-knowledge-mcqa dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa](https://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 239 |
+
2) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)).
|
| 240 |
+
|
| 241 |
+
One version of the teacher model used the following datasets:
|
| 242 |
+
|
| 243 |
+
1) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 244 |
+
2) Nemotron-RL-Instruction-Following-Calendar-v2 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 245 |
+
3) Nemotron-RL-instruction\_following-structured\_outputs dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following-structured\_outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following-structured_outputs)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 246 |
+
|
| 247 |
+
As described in the blog post, the model was fine tuned using the teacher models described above and the following datasets:
|
| 248 |
+
|
| 249 |
+
1) AReaL\_tau2 dataset ([https\://huggingface.co/datasets/inclusionAI/AReaL-tau2-data](https://huggingface.co/datasets/inclusionAI/AReaL-tau2-data)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 250 |
+
2) EnvFactory-SFT-FILTERED dataset ([https\://huggingface.co/datasets/LARK-Lab/EnvFactory-SFT-FILTERED](https://huggingface.co/datasets/LARK-Lab/EnvFactory-SFT-FILTERED)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 251 |
+
3) xlam-function-calling-60k dataset ([https\://huggingface.co/datasets/Salesforce/xlam-function-calling-60k](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 252 |
+
4) glaive-function-calling-v2 dataset ([https\://huggingface.co/datasets/glaiveai/glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 253 |
+
5) ToolACE dataset ([https\://huggingface.co/datasets/Team-ACE/ToolACE](https://huggingface.co/datasets/Team-ACE/ToolACE)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 254 |
+
6) When2call\_v2 dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://creativecommons.org/licenses/by/4.0/legalcode](https://creativecommons.org/licenses/by/4.0/legalcode));
|
| 255 |
+
7) Nemotron-SFT-Agentic-v2 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-SFT-Agentic-v2](https://huggingface.co/datasets/nvidia/Nemotron-SFT-Agentic-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md));
|
| 256 |
+
8) Infinity-Instruct dataset ([https\://huggingface.co/datasets/BAAI/Infinity-Instruct](https://huggingface.co/datasets/BAAI/Infinity-Instruct)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md));
|
| 257 |
+
9) toolbench\_v1 dataset ([https\://huggingface.co/datasets/tuandunghcmut/toolbench-v1](https://huggingface.co/datasets/tuandunghcmut/toolbench-v1)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 258 |
+
10) ToolMind dataset ([https\://huggingface.co/datasets/Nanbeige/ToolMind](https://huggingface.co/datasets/Nanbeige/ToolMind)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 259 |
+
11) Toucan-1.5M dataset (https\://huggingface.co/datasets/Agent-Ark/Toucan-1.5M) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 260 |
+
12) an unpublished synthetic dataset generated by Tether Data using Qwen3.5-9B ([https\://huggingface.co/Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B)) and Qwen3.6-27B ([https\://huggingface.co/Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B)), both of which are licensed under the Apache-2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)) and τ²-Bench made available under the MIT license ([https\://github.com/eligotts/tau2-bench?tab=License-1-ov-file](https://github.com/eligotts/tau2-bench?tab=License-1-ov-file));
|
| 261 |
+
13) xlam-irrelevance-7.5k dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md));
|
| 262 |
+
14) ultrachat\_200k dataset ([https\://huggingface.co/datasets/HuggingFaceH4/ultrachat\_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k)) made available under the MIT license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md));
|
| 263 |
+
15) smoltalk2 dataset ([https\://huggingface.co/datasets/HuggingFaceTB/smoltalk2](https://huggingface.co/datasets/HuggingFaceTB/smoltalk2)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 264 |
+
16) UltraData-SFT-2605 dataset ([https\://huggingface.co/datasets/openbmb/UltraData-SFT-2605](https://huggingface.co/datasets/openbmb/UltraData-SFT-2605)) made available under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/));
|
| 265 |
+
17) Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 266 |
+
18) Tool N1 dataset ([https\://github.com/NVlabs/Tool-N1](https://github.com/NVlabs/Tool-N1)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 267 |
+
19) IF\_multi\_constraints\_upto5 dataset ([https\://huggingface.co/datasets/allenai/IF\_multi\_constraints\_upto5](https://huggingface.co/datasets/allenai/IF_multi_constraints_upto5)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 268 |
+
20) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 269 |
+
21) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 270 |
+
22) xlam\_irrelevance-7.5K dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 271 |
+
23) Calendar-Scheduling-Dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 272 |
+
24) When2Call dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 273 |
+
25) ToolRL dataset ([https\://github.com/qiancheng0/ToolRL](https://github.com/qiancheng0/ToolRL)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 274 |
+
26) Nemotron-RL-Agentic-Function-Calling-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 275 |
+
27) DAPO-Math-17k dataset ([https\://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k)) dataset made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 276 |
+
28) Skywork-OR1-RL-Data dataset ([https\://huggingface.co/datasets/Skywork/Skywork-OR1-RL-Data](https://huggingface.co/datasets/Skywork/Skywork-OR1-RL-Data)) made accessible on Huggingface at the foregoing link;
|
| 277 |
+
29) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license (https\://opendatacommons.org/licenses/by/1-0/);
|
| 278 |
+
30) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a modified subset of the Nemotron-RL-knowledge-mcqa dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa](https://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 279 |
+
31) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-coding-competitive\_coding dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-coding-competitive\_coding](https://huggingface.co/datasets/nvidia/Nemotron-RL-coding-competitive_coding)) made available under the CC-BY-SA 4.0 (Creative Commons Share Attribution Alike 4.0 International) ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md));
|
| 280 |
+
32) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 281 |
+
33) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-agent-workplace\_assistant dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-agent-workplace\_assistant](https://huggingface.co/datasets/nvidia/Nemotron-RL-agent-workplace_assistant)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 282 |
+
34) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-instruction\_following-structured\_outputs dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following-structured\_outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following-structured_outputs)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 283 |
+
|
| 284 |
+
The full text of each license is reproduced in [ATTRIBUTIONS.md](https://huggingface.co/qvac/BotPsy-0.8B/blob/main/ATTRIBUTIONS.md).
|
botpsy-0.8b-q4_k_m/assets/template-6d877b321d680a20-chat_template.jinja
ADDED
|
@@ -0,0 +1,157 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{%- set image_count = namespace(value=0) %}
|
| 2 |
+
{%- set video_count = namespace(value=0) %}
|
| 3 |
+
{%- macro render_content(content, do_vision_count, is_system_content=false) %}
|
| 4 |
+
{%- if content is string %}
|
| 5 |
+
{{- content }}
|
| 6 |
+
{%- elif content is iterable and content is not mapping %}
|
| 7 |
+
{%- for item in content %}
|
| 8 |
+
{%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
|
| 9 |
+
{%- if is_system_content %}
|
| 10 |
+
{{- raise_exception('System message cannot contain images.') }}
|
| 11 |
+
{%- endif %}
|
| 12 |
+
{%- if do_vision_count %}
|
| 13 |
+
{%- set image_count.value = image_count.value + 1 %}
|
| 14 |
+
{%- endif %}
|
| 15 |
+
{%- if add_vision_id %}
|
| 16 |
+
{{- 'Picture ' ~ image_count.value ~ ': ' }}
|
| 17 |
+
{%- endif %}
|
| 18 |
+
{{- '<|vision_start|><|image_pad|><|vision_end|>' }}
|
| 19 |
+
{%- elif 'video' in item or item.type == 'video' %}
|
| 20 |
+
{%- if is_system_content %}
|
| 21 |
+
{{- raise_exception('System message cannot contain videos.') }}
|
| 22 |
+
{%- endif %}
|
| 23 |
+
{%- if do_vision_count %}
|
| 24 |
+
{%- set video_count.value = video_count.value + 1 %}
|
| 25 |
+
{%- endif %}
|
| 26 |
+
{%- if add_vision_id %}
|
| 27 |
+
{{- 'Video ' ~ video_count.value ~ ': ' }}
|
| 28 |
+
{%- endif %}
|
| 29 |
+
{{- '<|vision_start|><|video_pad|><|vision_end|>' }}
|
| 30 |
+
{%- elif 'text' in item %}
|
| 31 |
+
{{- item.text }}
|
| 32 |
+
{%- else %}
|
| 33 |
+
{{- raise_exception('Unexpected item type in content.') }}
|
| 34 |
+
{%- endif %}
|
| 35 |
+
{%- endfor %}
|
| 36 |
+
{%- elif content is none or content is undefined %}
|
| 37 |
+
{{- '' }}
|
| 38 |
+
{%- else %}
|
| 39 |
+
{{- raise_exception('Unexpected content type.') }}
|
| 40 |
+
{%- endif %}
|
| 41 |
+
{%- endmacro %}
|
| 42 |
+
{%- if not messages %}
|
| 43 |
+
{{- raise_exception('No messages provided.') }}
|
| 44 |
+
{%- endif %}
|
| 45 |
+
{%- if tools and tools is iterable and tools is not mapping %}
|
| 46 |
+
{{- '<|im_start|>system\n' }}
|
| 47 |
+
{{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
|
| 48 |
+
{%- for tool in tools %}
|
| 49 |
+
{{- "\n" }}
|
| 50 |
+
{{- tool | tojson }}
|
| 51 |
+
{%- endfor %}
|
| 52 |
+
{{- "\n</tools>" }}
|
| 53 |
+
{{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
|
| 54 |
+
{%- if messages[0].role == 'system' %}
|
| 55 |
+
{%- set content = render_content(messages[0].content, false, true)|trim %}
|
| 56 |
+
{%- if content %}
|
| 57 |
+
{{- '\n\n' + content }}
|
| 58 |
+
{%- endif %}
|
| 59 |
+
{%- endif %}
|
| 60 |
+
{{- '<|im_end|>\n' }}
|
| 61 |
+
{%- else %}
|
| 62 |
+
{%- if messages[0].role == 'system' %}
|
| 63 |
+
{%- set content = render_content(messages[0].content, false, true)|trim %}
|
| 64 |
+
{{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
|
| 65 |
+
{%- endif %}
|
| 66 |
+
{%- endif %}
|
| 67 |
+
{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
|
| 68 |
+
{%- for message in messages[::-1] %}
|
| 69 |
+
{%- set index = (messages|length - 1) - loop.index0 %}
|
| 70 |
+
{%- if ns.multi_step_tool and message.role == "user" %}
|
| 71 |
+
{%- set content = render_content(message.content, false)|trim %}
|
| 72 |
+
{%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
|
| 73 |
+
{%- set ns.multi_step_tool = false %}
|
| 74 |
+
{%- set ns.last_query_index = index %}
|
| 75 |
+
{%- endif %}
|
| 76 |
+
{%- endif %}
|
| 77 |
+
{%- endfor %}
|
| 78 |
+
{%- if ns.multi_step_tool %}
|
| 79 |
+
{{- raise_exception('No user query found in messages.') }}
|
| 80 |
+
{%- endif %}
|
| 81 |
+
{%- for message in messages %}
|
| 82 |
+
{%- set content = render_content(message.content, true)|trim %}
|
| 83 |
+
{%- if message.role == "system" %}
|
| 84 |
+
{%- if not loop.first %}
|
| 85 |
+
{{- raise_exception('System message must be at the beginning.') }}
|
| 86 |
+
{%- endif %}
|
| 87 |
+
{%- elif message.role == "user" %}
|
| 88 |
+
{{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
|
| 89 |
+
{%- elif message.role == "assistant" %}
|
| 90 |
+
{%- set reasoning_content = '' %}
|
| 91 |
+
{%- if message.reasoning_content is string %}
|
| 92 |
+
{%- set reasoning_content = message.reasoning_content %}
|
| 93 |
+
{%- else %}
|
| 94 |
+
{%- if '</think>' in content %}
|
| 95 |
+
{%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
|
| 96 |
+
{%- set content = content.split('</think>')[-1].lstrip('\n') %}
|
| 97 |
+
{%- endif %}
|
| 98 |
+
{%- endif %}
|
| 99 |
+
{%- set reasoning_content = reasoning_content|trim %}
|
| 100 |
+
{{- '<|im_start|>' + message.role + '\n' -}}
|
| 101 |
+
{% generation %}
|
| 102 |
+
{%- if loop.index0 > ns.last_query_index %}
|
| 103 |
+
{{- '<think>\n' + reasoning_content + '\n</think>\n\n' + content -}}
|
| 104 |
+
{%- else %}
|
| 105 |
+
{{- content -}}
|
| 106 |
+
{%- endif %}
|
| 107 |
+
{%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
|
| 108 |
+
{%- for tool_call in message.tool_calls %}
|
| 109 |
+
{%- if tool_call.function is defined %}
|
| 110 |
+
{%- set tool_call = tool_call.function %}
|
| 111 |
+
{%- endif %}
|
| 112 |
+
{%- if loop.first %}
|
| 113 |
+
{%- if content|trim %}
|
| 114 |
+
{{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 115 |
+
{%- else %}
|
| 116 |
+
{{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 117 |
+
{%- endif %}
|
| 118 |
+
{%- else %}
|
| 119 |
+
{{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 120 |
+
{%- endif %}
|
| 121 |
+
{%- if tool_call.arguments is defined %}
|
| 122 |
+
{%- for args_name, args_value in tool_call.arguments|items %}
|
| 123 |
+
{{- '<parameter=' + args_name + '>\n' }}
|
| 124 |
+
{%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
|
| 125 |
+
{{- args_value }}
|
| 126 |
+
{{- '\n</parameter>\n' }}
|
| 127 |
+
{%- endfor %}
|
| 128 |
+
{%- endif %}
|
| 129 |
+
{{- '</function>\n</tool_call>' }}
|
| 130 |
+
{%- endfor %}
|
| 131 |
+
{%- endif %}
|
| 132 |
+
{{- '<|im_end|>\n' }}
|
| 133 |
+
{%- endgeneration %}
|
| 134 |
+
{%- elif message.role == "tool" %}
|
| 135 |
+
{%- if loop.previtem and loop.previtem.role != "tool" %}
|
| 136 |
+
{{- '<|im_start|>user' }}
|
| 137 |
+
{%- endif %}
|
| 138 |
+
{{- '\n<tool_response>\n' }}
|
| 139 |
+
{{- content }}
|
| 140 |
+
{{- '\n</tool_response>' }}
|
| 141 |
+
{%- if not loop.last and loop.nextitem.role != "tool" %}
|
| 142 |
+
{{- '<|im_end|>\n' }}
|
| 143 |
+
{%- elif loop.last %}
|
| 144 |
+
{{- '<|im_end|>\n' }}
|
| 145 |
+
{%- endif %}
|
| 146 |
+
{%- else %}
|
| 147 |
+
{{- raise_exception('Unexpected message role.') }}
|
| 148 |
+
{%- endif %}
|
| 149 |
+
{%- endfor %}
|
| 150 |
+
{%- if add_generation_prompt %}
|
| 151 |
+
{{- '<|im_start|>assistant\n' }}
|
| 152 |
+
{%- if enable_thinking is defined and enable_thinking is true %}
|
| 153 |
+
{{- '<think>\n' }}
|
| 154 |
+
{%- else %}
|
| 155 |
+
{{- '<think>\n\n</think>\n\n' }}
|
| 156 |
+
{%- endif %}
|
| 157 |
+
{%- endif %}
|
botpsy-0.8b-q4_k_m/assets/tokenizer-06b9509352d2af50-tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523
|
| 3 |
+
size 19989325
|
botpsy-0.8b-q4_k_m/conversion-report.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29119b974ea86c457977f4473556c960e64dc91c02a40f8e33c4aee5356f671f
|
| 3 |
+
size 165409
|
botpsy-0.8b-q4_k_m/manifest.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:992f57426567c1b2d55eb31e5834e498e5bb1af6b2d81db0825c66521d7745f6
|
| 3 |
+
size 225258
|
botpsy-0.8b-q4_k_m/shard-000.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:54e92273feb9a249dc906d64dcdbc0d24c5fab0ad4783ff7ac3ab93aa5cc723e
|
| 3 |
+
size 67108176
|
botpsy-0.8b-q4_k_m/shard-001.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cfcaac5d0918bf64c2d8d3efe7128460523f538b8f4f41f167e77d7d0be68d9e
|
| 3 |
+
size 67108176
|
botpsy-0.8b-q4_k_m/shard-002.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:953dacb591bc4a4c213783ed94262660a3c38027cf63f85bfbbbc927901c35e9
|
| 3 |
+
size 67108176
|
botpsy-0.8b-q4_k_m/shard-003.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:049b5ab39a6173c1b9460f1b5503eb56cb39cba0b2eb251f3e58d291536c93cb
|
| 3 |
+
size 66249216
|
botpsy-0.8b-q4_k_m/shard-004.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:69dfc902df1eee239e672f38622c85aa8aca4d3c85ffc11869727be7a6f15a42
|
| 3 |
+
size 66556928
|
botpsy-0.8b-q4_k_m/shard-005.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79c8fd4e9b15eb9b91f5890335a5218282212faf7bdf96e694048eda15c891e1
|
| 3 |
+
size 63353856
|
botpsy-0.8b-q4_k_m/shard-006.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:145b8a3dcd046cfbe5b9bf01509053c2aa674e6d1a5299609cc371b5f8364608
|
| 3 |
+
size 66466816
|
botpsy-0.8b-q4_k_m/shard-007.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8cd7ff1e84a73f5c9e51080af81a80b3c2eb89a17eb5e138808be98df28e60f8
|
| 3 |
+
size 57217280
|
botpsy-0.8b-q8_0/assets/attribution-dcc5f18a858ad472-ATTRIBUTIONS.md
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
botpsy-0.8b-q8_0/assets/config-1dd43fe49e93b477-config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1dd43fe49e93b4778f67be093bf1d03b3a6cadf487ff5585ab7ffb2b34631543
|
| 3 |
+
size 2701
|
botpsy-0.8b-q8_0/assets/license-c71d239df91726fc-LICENSE
ADDED
|
@@ -0,0 +1,201 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Apache License
|
| 2 |
+
Version 2.0, January 2004
|
| 3 |
+
http://www.apache.org/licenses/
|
| 4 |
+
|
| 5 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 6 |
+
|
| 7 |
+
1. Definitions.
|
| 8 |
+
|
| 9 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 10 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 11 |
+
|
| 12 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 13 |
+
the copyright owner that is granting the License.
|
| 14 |
+
|
| 15 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 16 |
+
other entities that control, are controlled by, or are under common
|
| 17 |
+
control with that entity. For the purposes of this definition,
|
| 18 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 19 |
+
direction or management of such entity, whether by contract or
|
| 20 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 21 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 22 |
+
|
| 23 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 24 |
+
exercising permissions granted by this License.
|
| 25 |
+
|
| 26 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 27 |
+
including but not limited to software source code, documentation
|
| 28 |
+
source, and configuration files.
|
| 29 |
+
|
| 30 |
+
"Object" form shall mean any form resulting from mechanical
|
| 31 |
+
transformation or translation of a Source form, including but
|
| 32 |
+
not limited to compiled object code, generated documentation,
|
| 33 |
+
and conversions to other media types.
|
| 34 |
+
|
| 35 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 36 |
+
Object form, made available under the License, as indicated by a
|
| 37 |
+
copyright notice that is included in or attached to the work
|
| 38 |
+
(an example is provided in the Appendix below).
|
| 39 |
+
|
| 40 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 41 |
+
form, that is based on (or derived from) the Work and for which the
|
| 42 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 43 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 44 |
+
of this License, Derivative Works shall not include works that remain
|
| 45 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 46 |
+
the Work and Derivative Works thereof.
|
| 47 |
+
|
| 48 |
+
"Contribution" shall mean any work of authorship, including
|
| 49 |
+
the original version of the Work and any modifications or additions
|
| 50 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 51 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 52 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 53 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 54 |
+
means any form of electronic, verbal, or written communication sent
|
| 55 |
+
to the Licensor or its representatives, including but not limited to
|
| 56 |
+
communication on electronic mailing lists, source code control systems,
|
| 57 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 58 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 59 |
+
excluding communication that is conspicuously marked or otherwise
|
| 60 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 61 |
+
|
| 62 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 63 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 64 |
+
subsequently incorporated within the Work.
|
| 65 |
+
|
| 66 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 67 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 68 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 69 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 70 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 71 |
+
Work and such Derivative Works in Source or Object form.
|
| 72 |
+
|
| 73 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 74 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 75 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 76 |
+
(except as stated in this section) patent license to make, have made,
|
| 77 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 78 |
+
where such license applies only to those patent claims licensable
|
| 79 |
+
by such Contributor that are necessarily infringed by their
|
| 80 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 81 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 82 |
+
institute patent litigation against any entity (including a
|
| 83 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 84 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 85 |
+
or contributory patent infringement, then any patent licenses
|
| 86 |
+
granted to You under this License for that Work shall terminate
|
| 87 |
+
as of the date such litigation is filed.
|
| 88 |
+
|
| 89 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 90 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 91 |
+
modifications, and in Source or Object form, provided that You
|
| 92 |
+
meet the following conditions:
|
| 93 |
+
|
| 94 |
+
(a) You must give any other recipients of the Work or
|
| 95 |
+
Derivative Works a copy of this License; and
|
| 96 |
+
|
| 97 |
+
(b) You must cause any modified files to carry prominent notices
|
| 98 |
+
stating that You changed the files; and
|
| 99 |
+
|
| 100 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 101 |
+
that You distribute, all copyright, patent, trademark, and
|
| 102 |
+
attribution notices from the Source form of the Work,
|
| 103 |
+
excluding those notices that do not pertain to any part of
|
| 104 |
+
the Derivative Works; and
|
| 105 |
+
|
| 106 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 107 |
+
distribution, then any Derivative Works that You distribute must
|
| 108 |
+
include a readable copy of the attribution notices contained
|
| 109 |
+
within such NOTICE file, excluding those notices that do not
|
| 110 |
+
pertain to any part of the Derivative Works, in at least one
|
| 111 |
+
of the following places: within a NOTICE text file distributed
|
| 112 |
+
as part of the Derivative Works; within the Source form or
|
| 113 |
+
documentation, if provided along with the Derivative Works; or,
|
| 114 |
+
within a display generated by the Derivative Works, if and
|
| 115 |
+
wherever such third-party notices normally appear. The contents
|
| 116 |
+
of the NOTICE file are for informational purposes only and
|
| 117 |
+
do not modify the License. You may add Your own attribution
|
| 118 |
+
notices within Derivative Works that You distribute, alongside
|
| 119 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 120 |
+
that such additional attribution notices cannot be construed
|
| 121 |
+
as modifying the License.
|
| 122 |
+
|
| 123 |
+
You may add Your own copyright statement to Your modifications and
|
| 124 |
+
may provide additional or different license terms and conditions
|
| 125 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 126 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 127 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 128 |
+
the conditions stated in this License.
|
| 129 |
+
|
| 130 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 131 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 132 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 133 |
+
this License, without any additional terms or conditions.
|
| 134 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 135 |
+
the terms of any separate license agreement you may have executed
|
| 136 |
+
with Licensor regarding such Contributions.
|
| 137 |
+
|
| 138 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 139 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 140 |
+
except as required for reasonable and customary use in describing the
|
| 141 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 142 |
+
|
| 143 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 144 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 145 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 146 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 147 |
+
implied, including, without limitation, any warranties or conditions
|
| 148 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 149 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 150 |
+
appropriateness of using or redistributing the Work and assume any
|
| 151 |
+
risks associated with Your exercise of permissions under this License.
|
| 152 |
+
|
| 153 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 154 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 155 |
+
unless required by applicable law (such as deliberate and grossly
|
| 156 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 157 |
+
liable to You for damages, including any direct, indirect, special,
|
| 158 |
+
incidental, or consequential damages of any character arising as a
|
| 159 |
+
result of this License or out of the use or inability to use the
|
| 160 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 161 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 162 |
+
other commercial damages or losses), even if such Contributor
|
| 163 |
+
has been advised of the possibility of such damages.
|
| 164 |
+
|
| 165 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 166 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 167 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 168 |
+
or other liability obligations and/or rights consistent with this
|
| 169 |
+
License. However, in accepting such obligations, You may act only
|
| 170 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 171 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 172 |
+
defend, and hold each Contributor harmless for any liability
|
| 173 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 174 |
+
of your accepting any such warranty or additional liability.
|
| 175 |
+
|
| 176 |
+
END OF TERMS AND CONDITIONS
|
| 177 |
+
|
| 178 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 179 |
+
|
| 180 |
+
To apply the Apache License to your work, attach the following
|
| 181 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 182 |
+
replaced with your own identifying information. (Don't include
|
| 183 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 184 |
+
comment syntax for the file format. We also recommend that a
|
| 185 |
+
file or class name and description of purpose be included on the
|
| 186 |
+
same "printed page" as the copyright notice for easier
|
| 187 |
+
identification within third-party archives.
|
| 188 |
+
|
| 189 |
+
Copyright [yyyy] [name of copyright owner]
|
| 190 |
+
|
| 191 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 192 |
+
you may not use this file except in compliance with the License.
|
| 193 |
+
You may obtain a copy of the License at
|
| 194 |
+
|
| 195 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 196 |
+
|
| 197 |
+
Unless required by applicable law or agreed to in writing, software
|
| 198 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 199 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 200 |
+
See the License for the specific language governing permissions and
|
| 201 |
+
limitations under the License.
|
botpsy-0.8b-q8_0/assets/processor-d89ef49ce9cd37fb-processor_config.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d89ef49ce9cd37fbf510158e13c1ef063d9286411c1ec9049932dbe0487143b1
|
| 3 |
+
size 1191
|
botpsy-0.8b-q8_0/assets/readme-959811cca18e73a6-README.md
ADDED
|
@@ -0,0 +1,284 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
license_link: https://huggingface.co/qvac/BotPsy-0.8B/blob/main/LICENSE
|
| 4 |
+
language:
|
| 5 |
+
- en
|
| 6 |
+
library_name: transformers
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
+
base_model:
|
| 9 |
+
- Qwen/Qwen3.5-0.8B
|
| 10 |
+
base_model_relation: finetune
|
| 11 |
+
tags:
|
| 12 |
+
- tool-calling
|
| 13 |
+
- function-calling
|
| 14 |
+
- agent
|
| 15 |
+
- agentic
|
| 16 |
+
- on-device
|
| 17 |
+
- edge
|
| 18 |
+
- qwen3_5
|
| 19 |
+
- tether-ai
|
| 20 |
+
- qvac
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
# BotPsy-0.8B
|
| 24 |
+
|
| 25 |
+
**BotPsy-0.8B** is a 0.8B-parameter model designed for function calling and agentic workflows, built on top of [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) and suitable for on-device deployment. BotPsy is a "personal assistant" that uses tools to perform a variety of simple tasks for the user, in domains such as web search & research, travel & lifestyle, commerce & finance, business & customer operations, device & vehicle control, files & documents, calendar, and email & messaging. Due to its small parameter count, it is best suited to tasks of low to medium difficulty. BotPsy achieves state-of-the-art (SOTA) tool-use and agentic performance for its size, outperforming every model of up to 1.2B parameters that we tested. As a small model, BotPsy still makes mistakes and is best suited to tasks of low to medium difficulty; please read the [Intended Use and Limitations](#intended-use-and-limitations) section for more information.
|
| 26 |
+
|
| 27 |
+
This repository holds the BF16 weights in Hugging Face safetensors format. GGUF files (BF16, Q8_0 and Q4_K_M) for llama.cpp and the QVAC SDK are in [qvac/BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs). The full write-up, with every benchmark and the training method, is the [BotPsy blog post](https://huggingface.co/blog/qvac/botpsy).
|
| 28 |
+
|
| 29 |
+
| | |
|
| 30 |
+
|:---|:---|
|
| 31 |
+
| **Developed by** | [Tether AI Research](https://tether.io/)<sup>*</sup> |
|
| 32 |
+
| **Model type** | Causal language model for tool calling (Qwen3.5 architecture: hybrid Gated DeltaNet + gated attention), used text-only |
|
| 33 |
+
| **Parameters** | 0.8B |
|
| 34 |
+
| **Base model** | [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) |
|
| 35 |
+
| **Reasoning** | Thinks before it answers (thinking mode, `enable_thinking=True`) |
|
| 36 |
+
| **Language** | English (recommended) |
|
| 37 |
+
| **Precision** | BF16 (this repository); BF16, Q8_0 and Q4_K_M GGUF in [BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs) |
|
| 38 |
+
| **License** | [Apache 2.0](https://huggingface.co/qvac/BotPsy-0.8B/blob/main/LICENSE) |
|
| 39 |
+
| **Blog post** | [BotPsy on Hugging Face](https://huggingface.co/blog/qvac/botpsy) |
|
| 40 |
+
| **Collection** | [BotPsy](https://huggingface.co/collections/qvac/botpsy) |
|
| 41 |
+
|
| 42 |
+
<sup>*</sup> References to Tether AI Research are references to Tether Data, S.A. de C.V.
|
| 43 |
+
|
| 44 |
+
## Key Highlights
|
| 45 |
+
|
| 46 |
+
### Benchmark results
|
| 47 |
+
- **Twice the performance of its base model:** BotPsy roughly doubles the agentic capability of Qwen3.5-0.8B-Think on key benchmarks: BFCL v4 rises from 23.4 to 44.0, ACEBench from 30.1 to 58.7, and τ-bench from 23.2 to 51.5 (mean of the retail, telecom and banking subsets).
|
| 48 |
+
- **Best agent in its category:** BotPsy outperforms leading models in the ≤1.2B-parameter weight class (Qwen3.5-0.8B-Think, LFM2.5-1.2B-Think, MiniCPM5-1B-Think) on all six tool-use and agentic benchmarks: BFCL v4, ACEBench, τ-bench, ToolSandbox, Claw-Eval and BrowseComp-Plus.
|
| 49 |
+
- **Outperforms its larger sibling:** BotPsy has the highest score of all models tested on five of the six benchmarks, beating Qwen3.5-2B-Think, a model 2.5× its size, on BFCL v4 (44.0 vs 37.7), ACEBench (58.7 vs 55.4), τ-bench (51.5 vs 46.5), ToolSandbox (64.6 vs 41.2) and BrowseComp-Plus (4.5 vs 2.8). Only on Claw-Eval does Qwen3.5-2B-Think lead (48.9 vs 46.5).
|
| 50 |
+
|
| 51 |
+
### Model capabilities
|
| 52 |
+
- **More reliable in multi-turn workflows:** On τ²-bench, where the agent must hold a long customer conversation, follow a strict policy, and act on the customer's behalf, it scores 82.5 in telecom, ahead of Qwen3.5-2B-Think (69.3). On BFCL v4's multi-turn tasks, it rises from 7.5 to 46.1 over its base, nearly double Qwen3.5-2B-Think (23.8). Grouped by application, its multi-step scores lead all models tested in commerce and services (58.3 vs 47.4 for the next best, Qwen3.5-2B-Think) and in device and system management (46.1 vs 31.9).
|
| 53 |
+
- **Knows when (not) to call tools:** An agent that acts must also know when not to act. On BFCL v4's hallucination tests, which check that the model declines when no appropriate tool exists, BotPsy scores 86.1, the highest of all models tested. On ACEBench's special cases, where the request is incomplete, contains wrong parameters, or cannot be served by the given tools, it scores 51.3, up from 13.7 for its base model.
|
| 54 |
+
- **Follows instructions while preserving knowledge:** BotPsy specializes in tool use while preserving general skills. Instruction following improves sharply, with IFEval rising from 59.7 to 90.8 and IFBench from 22.0 to 55.9, the highest IFBench score of all models tested. General knowledge also improves, with GPQA Diamond rising from 33.2 to 38.1 and MMLU-Pro from 41.6 to 48.9. On all four benchmarks, BotPsy outperforms every other model of 1.2B parameters or fewer that we tested.
|
| 55 |
+
|
| 56 |
+
## Benchmark Results
|
| 57 |
+
|
| 58 |
+
All five models were evaluated in thinking mode with one shared evaluation harness. BotPsy was served from these BF16 weights with vLLM. Best score per row in **bold**, second best <u>underlined</u>; multipliers give parameter count relative to BotPsy-0.8B.
|
| 59 |
+
|
| 60 |
+
| Benchmark | **BotPsy-0.8B**<br><sub>ours</sub> | Qwen3.5-0.8B-Think<br><sub>base · 1×</sub> | Qwen3.5-2B-Think<br><sub>2.5×</sub> | LFM2.5-1.2B-Think<br><sub>1.5×</sub> | MiniCPM5-1B-Think<br><sub>1.25×</sub> |
|
| 61 |
+
| :--- | :---: | :---: | :---: | :---: | :---: |
|
| 62 |
+
| ***Tool use & agents*** | | | | | |
|
| 63 |
+
| BFCL v4¹ | **44.0** | 23.4 | <u>37.7</u> | 28.1 | 22.8 |
|
| 64 |
+
| ACEBench² | **58.7** | 30.1 | <u>55.4</u> | 39.4 | 24.5 |
|
| 65 |
+
| τ-bench³ | **51.5** | 23.2 | <u>46.5</u> | 6.5 | 28.8 |
|
| 66 |
+
| Claw-Eval⁴ | <u>46.5</u> | 39.3 | **48.9** | 31.6 | 31.0 |
|
| 67 |
+
| BrowseComp-Plus⁵ | **4.5** | 1.9 | <u>2.8</u> | 0.2 | 0.8 |
|
| 68 |
+
| ToolSandbox⁶ | **64.6** | 30.5 | 41.2 | <u>45.7</u> | 28.1 |
|
| 69 |
+
| *Average* | ***45.0*** | *24.7* | *<u>38.8</u>* | *25.3* | *22.7* |
|
| 70 |
+
| ***Knowledge*** | | | | | |
|
| 71 |
+
| GPQA Diamond⁷ | <u>38.1</u> | 33.2 | **59.9** | 35.0 | 15.8 |
|
| 72 |
+
| MMLU-Pro⁸ | <u>48.9</u> | 41.6 | **65.5** | 39.4 | 40.0 |
|
| 73 |
+
| ***Instruction following*** | | | | | |
|
| 74 |
+
| IFEval⁹ | **90.8** | 59.7 | 80.0 | <u>85.6</u> | 78.4 |
|
| 75 |
+
| IFBench⁹ | **55.9** | 22.0 | <u>40.9</u> | 33.9 | 40.6 |
|
| 76 |
+
| Multi-IF¹⁰ | <u>67.2</u> | 43.2 | 66.9 | **68.2** | 53.4 |
|
| 77 |
+
|
| 78 |
+
<details>
|
| 79 |
+
<summary>Evaluation footnotes</summary>
|
| 80 |
+
|
| 81 |
+
- All scores are percentages (higher is better).
|
| 82 |
+
- All models were evaluated in thinking (reasoning) mode.
|
| 83 |
+
- All benchmarks that use an external API were run on **November 3, 2026**.
|
| 84 |
+
- ¹ BFCL v4: overall score calculated using the official weighted formula (40% Agentic, 30% Multi-Turn, 10% Live, 10% Non-Live, and 10% Hallucination), averaged over 3 runs.
|
| 85 |
+
- ² ACEBench: overall accuracy. All models were evaluated in function-calling (FC) mode; mean of 2 runs.
|
| 86 |
+
- ³ τ-bench: average of τ²-bench (retail, telecom) and τ³-bench (banking), excluding airline; mean of 3 runs.
|
| 87 |
+
- ⁴ Claw-Eval: official average task score, where each task scores safety × (0.8 × completion + 0.2 × robustness); mean of 3 runs.
|
| 88 |
+
- ⁵ BrowseComp-Plus: accuracy, with a maximum of 30 steps for all models.
|
| 89 |
+
- ⁶ ToolSandbox: mean similarity score over 8 settings.
|
| 90 |
+
- ⁷ GPQA Diamond: accuracy over all 198 questions, mean of 3 runs, thinking enabled.
|
| 91 |
+
- ⁸ MMLU-Pro: accuracy.
|
| 92 |
+
- ⁹ IFEval, IFBench: prompt-level strict accuracy.
|
| 93 |
+
- ¹⁰ Multi-IF: average of 3 runs.
|
| 94 |
+
|
| 95 |
+
</details>
|
| 96 |
+
|
| 97 |
+
BotPsy's weaker spots are open-ended search and a few areas where Qwen3.5-2B-Think still leads: BrowseComp-Plus deep research (4.5, the best of the five but low in absolute terms), BFCL web search (14.0) and memory (16.3), Claw-Eval, and ACEBench's special cases. On τ³-banking no model gets above 5. Knowledge still scales mainly with parameter count, so BotPsy is designed to call tools for facts it does not know, not to serve as a knowledge model. See the [blog post](https://huggingface.co/blog/qvac/botpsy) for the multi-turn, app-level and efficiency analyses.
|
| 98 |
+
|
| 99 |
+
## Training
|
| 100 |
+
|
| 101 |
+
BotPsy is based on Qwen3.5-0.8B and is post-trained in four stages: supervised fine-tuning, multi-teacher on-policy distillation, and two rounds of reinforcement learning. See the [blog post (Methodology)](https://huggingface.co/blog/qvac/botpsy#methodology) for the training recipe and data composition. Training code and training data are not part of this release; the datasets used are listed under [Licensing](#licensing).
|
| 102 |
+
|
| 103 |
+
## Usage
|
| 104 |
+
|
| 105 |
+
BotPsy keeps the Qwen3.5 architecture, so Hugging Face Transformers, vLLM and llama.cpp run it without custom code. Two settings matter.
|
| 106 |
+
|
| 107 |
+
- **Turn thinking on.** BotPsy was trained and evaluated in thinking mode. The chat template defaults to non-thinking, so pass `enable_thinking=True`.
|
| 108 |
+
- **Sampling.** Our evaluations used `temperature=0.3`, `top_p=0.95`, `top_k=20`, `presence_penalty=1.5` and up to 32,768 new tokens. `generation_config.json` sets the first three; presence penalty is available in vLLM and llama.cpp.
|
| 109 |
+
|
| 110 |
+
### Transformers
|
| 111 |
+
|
| 112 |
+
Requires a `transformers` release with Qwen3.5 support (tested with 5.19.0). Install `flash-linear-attention` and `causal-conv1d` for the fast Gated DeltaNet kernels; without them Transformers falls back to a slower reference implementation.
|
| 113 |
+
|
| 114 |
+
```python
|
| 115 |
+
import torch
|
| 116 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 117 |
+
|
| 118 |
+
model_id = "qvac/BotPsy-0.8B"
|
| 119 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 120 |
+
device = "cuda" if torch.cuda.is_available() else "cpu"
|
| 121 |
+
model = AutoModelForCausalLM.from_pretrained(model_id, dtype=torch.bfloat16).to(device)
|
| 122 |
+
|
| 123 |
+
tools = [{
|
| 124 |
+
"type": "function",
|
| 125 |
+
"function": {
|
| 126 |
+
"name": "create_event",
|
| 127 |
+
"description": "Add an event to the user's calendar",
|
| 128 |
+
"parameters": {
|
| 129 |
+
"type": "object",
|
| 130 |
+
"properties": {
|
| 131 |
+
"title": {"type": "string"},
|
| 132 |
+
"day": {"type": "string", "description": "Day of the week"},
|
| 133 |
+
"time": {"type": "string", "description": "Start time, 24h HH:MM"},
|
| 134 |
+
},
|
| 135 |
+
"required": ["title", "day", "time"],
|
| 136 |
+
},
|
| 137 |
+
},
|
| 138 |
+
}]
|
| 139 |
+
messages = [{"role": "user", "content": "Add the dentist on Friday at 3 pm."}]
|
| 140 |
+
|
| 141 |
+
inputs = tokenizer.apply_chat_template(
|
| 142 |
+
messages, tools=tools, add_generation_prompt=True, enable_thinking=True,
|
| 143 |
+
return_dict=True, return_tensors="pt",
|
| 144 |
+
).to(model.device)
|
| 145 |
+
out = model.generate(**inputs, max_new_tokens=4096) # sampling from generation_config.json
|
| 146 |
+
print(tokenizer.decode(out[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))
|
| 147 |
+
```
|
| 148 |
+
|
| 149 |
+
The answer ends with a tool call in the Qwen3.5 XML format:
|
| 150 |
+
|
| 151 |
+
```
|
| 152 |
+
<tool_call>
|
| 153 |
+
<function=create_event>
|
| 154 |
+
<parameter=title>
|
| 155 |
+
Dentist
|
| 156 |
+
</parameter>
|
| 157 |
+
...
|
| 158 |
+
</function>
|
| 159 |
+
</tool_call>
|
| 160 |
+
```
|
| 161 |
+
|
| 162 |
+
### vLLM (OpenAI-compatible server)
|
| 163 |
+
|
| 164 |
+
```bash
|
| 165 |
+
vllm serve qvac/BotPsy-0.8B --language-model-only \
|
| 166 |
+
--enable-auto-tool-choice --tool-call-parser qwen3_xml --reasoning-parser qwen3
|
| 167 |
+
```
|
| 168 |
+
|
| 169 |
+
```python
|
| 170 |
+
from openai import OpenAI
|
| 171 |
+
|
| 172 |
+
client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
|
| 173 |
+
resp = client.chat.completions.create(
|
| 174 |
+
model="qvac/BotPsy-0.8B",
|
| 175 |
+
messages=[{"role": "user", "content": "Add the dentist on Friday at 3 pm."}],
|
| 176 |
+
tools=tools, # same list as in the Transformers example
|
| 177 |
+
temperature=0.3, top_p=0.95, presence_penalty=1.5, max_tokens=8192,
|
| 178 |
+
extra_body={"top_k": 20, "chat_template_kwargs": {"enable_thinking": True}},
|
| 179 |
+
)
|
| 180 |
+
print(resp.choices[0].message.tool_calls)
|
| 181 |
+
```
|
| 182 |
+
|
| 183 |
+
### llama.cpp and the QVAC SDK
|
| 184 |
+
|
| 185 |
+
Use the GGUF files in [qvac/BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs); its model card has llama.cpp and QVAC SDK examples.
|
| 186 |
+
|
| 187 |
+
## Intended Use and Limitations
|
| 188 |
+
|
| 189 |
+
BotPsy has been developed to advance the state of the art and to support research and educational uses. Models developed based on our work could be suitable for tasks in domains such as device & system management (settings, files & documents, clocks & alarms), personal productivity & work (calendar & tasks, email, collaboration tools), communication (messaging), information retrieval & research (web search, weather, news), media & lifestyle (video, music, recipes & fitness, photos) and commerce & services (maps & travel, finance, shopping & delivery). Due to its small parameter count, it is best suited to tasks of low to medium difficulty.
|
| 190 |
+
|
| 191 |
+
BotPsy has been primarily trained and tested in English, which is the recommended language. It has also been evaluated on Multi-IF, which covers seven additional languages (Chinese, French, Hindi, Italian, Portuguese, Russian and Spanish): it performs well in most of them, but scores much lower in Hindi and Russian. BotPsy is a small language model, and it makes mistakes. It is not intended for safety-critical or high-stakes automated decisions, or for applications involving money, personal information, health and other sensitive topics.
|
| 192 |
+
|
| 193 |
+
## Related Resources
|
| 194 |
+
|
| 195 |
+
- [BotPsy blog post](https://huggingface.co/blog/qvac/botpsy): methodology, all benchmarks, app-level breakdown, inference efficiency
|
| 196 |
+
- [BotPsy-0.8B-GGUFs](https://huggingface.co/qvac/BotPsy-0.8B-GGUFs): BF16, Q8_0 and Q4_K_M GGUF files for llama.cpp and the QVAC SDK
|
| 197 |
+
- [BotPsy collection](https://huggingface.co/collections/qvac/botpsy)
|
| 198 |
+
- [QVAC SDK](https://qvac.tether.io/dev/sdk/): on-device AI deployment framework
|
| 199 |
+
- [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B): base model
|
| 200 |
+
|
| 201 |
+
## Citation
|
| 202 |
+
|
| 203 |
+
```bibtex
|
| 204 |
+
@misc{botpsy2026,
|
| 205 |
+
title = {BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model},
|
| 206 |
+
author = {Tether Data, S.A. de C.V. d.b.a. Tether AI Research},
|
| 207 |
+
year = {2026},
|
| 208 |
+
howpublished = {Hugging Face blog},
|
| 209 |
+
url = {https://huggingface.co/blog/qvac/botpsy}
|
| 210 |
+
}
|
| 211 |
+
```
|
| 212 |
+
|
| 213 |
+
## Copyright Complaints
|
| 214 |
+
|
| 215 |
+
We will take appropriate actions in response to notice of copyright infringement. If you believe your work has been used or copied in a manner that infringes upon your intellectual property rights, please email [data-apps@tether.io](mailto:data-apps@tether.io) identifying and describing both the copyrighted work and alleged infringing content to file a notice of infringement.
|
| 216 |
+
|
| 217 |
+
## Licensing
|
| 218 |
+
|
| 219 |
+
This model which was trained as described in the [blog post](https://huggingface.co/blog/qvac/botpsy) is licensed by Tether Data, S.A. de C.V. under the [Apache 2.0](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md) license. As described in the blog post, this model is a version of the Qwen3.5-0.8B (Thinking) model ([https\://huggingface.co/Qwen/Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B)) which is licensed under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)).
|
| 220 |
+
|
| 221 |
+
As described in the blog post, the Qwen3.5-4B model ([https\://huggingface.co/Qwen/Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B)) which is licensed under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)) was put through three different reinforcement learning processes to create three versions of the model and each of those three versions of the model were then used as a teacher model.
|
| 222 |
+
|
| 223 |
+
Only subsets of some of the datasets listed below were used.
|
| 224 |
+
|
| 225 |
+
One version of the teacher model used the following datasets:
|
| 226 |
+
|
| 227 |
+
1) Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 228 |
+
2) Tool N1 dataset ([https\://github.com/NVlabs/Tool-N1](https://github.com/NVlabs/Tool-N1)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 229 |
+
3) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 230 |
+
4) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 231 |
+
5) xlam-irrelevance-7.5k dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 232 |
+
6) When2Call dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 233 |
+
7) ToolRL dataset ([https\://github.com/qiancheng0/ToolRL](https://github.com/qiancheng0/ToolRL)) made available under the Apache 2.0 license ([https\://github.com/qiancheng0/ToolRL?tab=Apache-2.0-1-ov-file](https://github.com/qiancheng0/ToolRL?tab=Apache-2.0-1-ov-file)); and
|
| 234 |
+
8) Nemotron-RL-Agentic-Function-Calling-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 235 |
+
|
| 236 |
+
One version of the teacher model used the following datasets:
|
| 237 |
+
|
| 238 |
+
1) Nemotron-RL-knowledge-mcqa dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa](https://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 239 |
+
2) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)).
|
| 240 |
+
|
| 241 |
+
One version of the teacher model used the following datasets:
|
| 242 |
+
|
| 243 |
+
1) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 244 |
+
2) Nemotron-RL-Instruction-Following-Calendar-v2 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 245 |
+
3) Nemotron-RL-instruction\_following-structured\_outputs dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following-structured\_outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following-structured_outputs)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 246 |
+
|
| 247 |
+
As described in the blog post, the model was fine tuned using the teacher models described above and the following datasets:
|
| 248 |
+
|
| 249 |
+
1) AReaL\_tau2 dataset ([https\://huggingface.co/datasets/inclusionAI/AReaL-tau2-data](https://huggingface.co/datasets/inclusionAI/AReaL-tau2-data)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 250 |
+
2) EnvFactory-SFT-FILTERED dataset ([https\://huggingface.co/datasets/LARK-Lab/EnvFactory-SFT-FILTERED](https://huggingface.co/datasets/LARK-Lab/EnvFactory-SFT-FILTERED)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 251 |
+
3) xlam-function-calling-60k dataset ([https\://huggingface.co/datasets/Salesforce/xlam-function-calling-60k](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 252 |
+
4) glaive-function-calling-v2 dataset ([https\://huggingface.co/datasets/glaiveai/glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 253 |
+
5) ToolACE dataset ([https\://huggingface.co/datasets/Team-ACE/ToolACE](https://huggingface.co/datasets/Team-ACE/ToolACE)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 254 |
+
6) When2call\_v2 dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://creativecommons.org/licenses/by/4.0/legalcode](https://creativecommons.org/licenses/by/4.0/legalcode));
|
| 255 |
+
7) Nemotron-SFT-Agentic-v2 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-SFT-Agentic-v2](https://huggingface.co/datasets/nvidia/Nemotron-SFT-Agentic-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md));
|
| 256 |
+
8) Infinity-Instruct dataset ([https\://huggingface.co/datasets/BAAI/Infinity-Instruct](https://huggingface.co/datasets/BAAI/Infinity-Instruct)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md));
|
| 257 |
+
9) toolbench\_v1 dataset ([https\://huggingface.co/datasets/tuandunghcmut/toolbench-v1](https://huggingface.co/datasets/tuandunghcmut/toolbench-v1)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 258 |
+
10) ToolMind dataset ([https\://huggingface.co/datasets/Nanbeige/ToolMind](https://huggingface.co/datasets/Nanbeige/ToolMind)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 259 |
+
11) Toucan-1.5M dataset (https\://huggingface.co/datasets/Agent-Ark/Toucan-1.5M) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 260 |
+
12) an unpublished synthetic dataset generated by Tether Data using Qwen3.5-9B ([https\://huggingface.co/Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B)) and Qwen3.6-27B ([https\://huggingface.co/Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B)), both of which are licensed under the Apache-2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/)) and τ²-Bench made available under the MIT license ([https\://github.com/eligotts/tau2-bench?tab=License-1-ov-file](https://github.com/eligotts/tau2-bench?tab=License-1-ov-file));
|
| 261 |
+
13) xlam-irrelevance-7.5k dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-4.0.md));
|
| 262 |
+
14) ultrachat\_200k dataset ([https\://huggingface.co/datasets/HuggingFaceH4/ultrachat\_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k)) made available under the MIT license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md));
|
| 263 |
+
15) smoltalk2 dataset ([https\://huggingface.co/datasets/HuggingFaceTB/smoltalk2](https://huggingface.co/datasets/HuggingFaceTB/smoltalk2)) made available under the Apache 2.0 license ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md));
|
| 264 |
+
16) UltraData-SFT-2605 dataset ([https\://huggingface.co/datasets/openbmb/UltraData-SFT-2605](https://huggingface.co/datasets/openbmb/UltraData-SFT-2605)) made available under the Apache 2.0 license ([https\://choosealicense.com/licenses/apache-2.0/](https://choosealicense.com/licenses/apache-2.0/));
|
| 265 |
+
17) Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 266 |
+
18) Tool N1 dataset ([https\://github.com/NVlabs/Tool-N1](https://github.com/NVlabs/Tool-N1)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 267 |
+
19) IF\_multi\_constraints\_upto5 dataset ([https\://huggingface.co/datasets/allenai/IF\_multi\_constraints\_upto5](https://huggingface.co/datasets/allenai/IF_multi_constraints_upto5)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 268 |
+
20) SuperGPQA dataset ([https\://huggingface.co/datasets/m-a-p/SuperGPQA](https://huggingface.co/datasets/m-a-p/SuperGPQA)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 269 |
+
21) Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 270 |
+
22) xlam\_irrelevance-7.5K dataset ([https\://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 271 |
+
23) Calendar-Scheduling-Dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2](https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Calendar-v2)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 272 |
+
24) When2Call dataset ([https\://huggingface.co/datasets/nvidia/When2Call](https://huggingface.co/datasets/nvidia/When2Call)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 273 |
+
25) ToolRL dataset ([https\://github.com/qiancheng0/ToolRL](https://github.com/qiancheng0/ToolRL)) made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 274 |
+
26) Nemotron-RL-Agentic-Function-Calling-Pivot-v1 dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1](https://huggingface.co/datasets/nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license (https\://choosealicense.com/licenses/cc-by-4.0/);
|
| 275 |
+
27) DAPO-Math-17k dataset ([https\://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k)) dataset made available under the Apache 2.0 license ([https\://github.com/NVlabs/Tool-N1/blob/master/LICENSE](https://github.com/NVlabs/Tool-N1/blob/master/LICENSE));
|
| 276 |
+
28) Skywork-OR1-RL-Data dataset ([https\://huggingface.co/datasets/Skywork/Skywork-OR1-RL-Data](https://huggingface.co/datasets/Skywork/Skywork-OR1-RL-Data)) made accessible on Huggingface at the foregoing link;
|
| 277 |
+
29) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license (https\://opendatacommons.org/licenses/by/1-0/);
|
| 278 |
+
30) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a modified subset of the Nemotron-RL-knowledge-mcqa dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa](https://huggingface.co/datasets/nvidia/Nemotron-RL-knowledge-mcqa)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/));
|
| 279 |
+
31) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-coding-competitive\_coding dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-coding-competitive\_coding](https://huggingface.co/datasets/nvidia/Nemotron-RL-coding-competitive_coding)) made available under the CC-BY-SA 4.0 (Creative Commons Share Attribution Alike 4.0 International) ([https\://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/cc-by-sa-4.0.md));
|
| 280 |
+
32) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-instruction\_following dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/));
|
| 281 |
+
33) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-agent-workplace\_assistant dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-agent-workplace\_assistant](https://huggingface.co/datasets/nvidia/Nemotron-RL-agent-workplace_assistant)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)); and
|
| 282 |
+
34) Nemotron-3-Nano-RL-Training-Blend dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend](https://huggingface.co/datasets/nvidia/Nemotron-3-Nano-RL-Training-Blend)) made available under the ODC-BY (Open Data Commons Attribution License v1.0) license ([https\://opendatacommons.org/licenses/by/1-0/](https://opendatacommons.org/licenses/by/1-0/)) which are a subset of the Nemotron-RL-instruction\_following-structured\_outputs dataset ([https\://huggingface.co/datasets/nvidia/Nemotron-RL-instruction\_following-structured\_outputs](https://huggingface.co/datasets/nvidia/Nemotron-RL-instruction_following-structured_outputs)) made available under the CC-BY 4.0 (Creative Commons Attribution 4.0 International) license ([https\://choosealicense.com/licenses/cc-by-4.0/](https://choosealicense.com/licenses/cc-by-4.0/)).
|
| 283 |
+
|
| 284 |
+
The full text of each license is reproduced in [ATTRIBUTIONS.md](https://huggingface.co/qvac/BotPsy-0.8B/blob/main/ATTRIBUTIONS.md).
|
botpsy-0.8b-q8_0/assets/template-6d877b321d680a20-chat_template.jinja
ADDED
|
@@ -0,0 +1,157 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{%- set image_count = namespace(value=0) %}
|
| 2 |
+
{%- set video_count = namespace(value=0) %}
|
| 3 |
+
{%- macro render_content(content, do_vision_count, is_system_content=false) %}
|
| 4 |
+
{%- if content is string %}
|
| 5 |
+
{{- content }}
|
| 6 |
+
{%- elif content is iterable and content is not mapping %}
|
| 7 |
+
{%- for item in content %}
|
| 8 |
+
{%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
|
| 9 |
+
{%- if is_system_content %}
|
| 10 |
+
{{- raise_exception('System message cannot contain images.') }}
|
| 11 |
+
{%- endif %}
|
| 12 |
+
{%- if do_vision_count %}
|
| 13 |
+
{%- set image_count.value = image_count.value + 1 %}
|
| 14 |
+
{%- endif %}
|
| 15 |
+
{%- if add_vision_id %}
|
| 16 |
+
{{- 'Picture ' ~ image_count.value ~ ': ' }}
|
| 17 |
+
{%- endif %}
|
| 18 |
+
{{- '<|vision_start|><|image_pad|><|vision_end|>' }}
|
| 19 |
+
{%- elif 'video' in item or item.type == 'video' %}
|
| 20 |
+
{%- if is_system_content %}
|
| 21 |
+
{{- raise_exception('System message cannot contain videos.') }}
|
| 22 |
+
{%- endif %}
|
| 23 |
+
{%- if do_vision_count %}
|
| 24 |
+
{%- set video_count.value = video_count.value + 1 %}
|
| 25 |
+
{%- endif %}
|
| 26 |
+
{%- if add_vision_id %}
|
| 27 |
+
{{- 'Video ' ~ video_count.value ~ ': ' }}
|
| 28 |
+
{%- endif %}
|
| 29 |
+
{{- '<|vision_start|><|video_pad|><|vision_end|>' }}
|
| 30 |
+
{%- elif 'text' in item %}
|
| 31 |
+
{{- item.text }}
|
| 32 |
+
{%- else %}
|
| 33 |
+
{{- raise_exception('Unexpected item type in content.') }}
|
| 34 |
+
{%- endif %}
|
| 35 |
+
{%- endfor %}
|
| 36 |
+
{%- elif content is none or content is undefined %}
|
| 37 |
+
{{- '' }}
|
| 38 |
+
{%- else %}
|
| 39 |
+
{{- raise_exception('Unexpected content type.') }}
|
| 40 |
+
{%- endif %}
|
| 41 |
+
{%- endmacro %}
|
| 42 |
+
{%- if not messages %}
|
| 43 |
+
{{- raise_exception('No messages provided.') }}
|
| 44 |
+
{%- endif %}
|
| 45 |
+
{%- if tools and tools is iterable and tools is not mapping %}
|
| 46 |
+
{{- '<|im_start|>system\n' }}
|
| 47 |
+
{{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
|
| 48 |
+
{%- for tool in tools %}
|
| 49 |
+
{{- "\n" }}
|
| 50 |
+
{{- tool | tojson }}
|
| 51 |
+
{%- endfor %}
|
| 52 |
+
{{- "\n</tools>" }}
|
| 53 |
+
{{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
|
| 54 |
+
{%- if messages[0].role == 'system' %}
|
| 55 |
+
{%- set content = render_content(messages[0].content, false, true)|trim %}
|
| 56 |
+
{%- if content %}
|
| 57 |
+
{{- '\n\n' + content }}
|
| 58 |
+
{%- endif %}
|
| 59 |
+
{%- endif %}
|
| 60 |
+
{{- '<|im_end|>\n' }}
|
| 61 |
+
{%- else %}
|
| 62 |
+
{%- if messages[0].role == 'system' %}
|
| 63 |
+
{%- set content = render_content(messages[0].content, false, true)|trim %}
|
| 64 |
+
{{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
|
| 65 |
+
{%- endif %}
|
| 66 |
+
{%- endif %}
|
| 67 |
+
{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
|
| 68 |
+
{%- for message in messages[::-1] %}
|
| 69 |
+
{%- set index = (messages|length - 1) - loop.index0 %}
|
| 70 |
+
{%- if ns.multi_step_tool and message.role == "user" %}
|
| 71 |
+
{%- set content = render_content(message.content, false)|trim %}
|
| 72 |
+
{%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
|
| 73 |
+
{%- set ns.multi_step_tool = false %}
|
| 74 |
+
{%- set ns.last_query_index = index %}
|
| 75 |
+
{%- endif %}
|
| 76 |
+
{%- endif %}
|
| 77 |
+
{%- endfor %}
|
| 78 |
+
{%- if ns.multi_step_tool %}
|
| 79 |
+
{{- raise_exception('No user query found in messages.') }}
|
| 80 |
+
{%- endif %}
|
| 81 |
+
{%- for message in messages %}
|
| 82 |
+
{%- set content = render_content(message.content, true)|trim %}
|
| 83 |
+
{%- if message.role == "system" %}
|
| 84 |
+
{%- if not loop.first %}
|
| 85 |
+
{{- raise_exception('System message must be at the beginning.') }}
|
| 86 |
+
{%- endif %}
|
| 87 |
+
{%- elif message.role == "user" %}
|
| 88 |
+
{{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
|
| 89 |
+
{%- elif message.role == "assistant" %}
|
| 90 |
+
{%- set reasoning_content = '' %}
|
| 91 |
+
{%- if message.reasoning_content is string %}
|
| 92 |
+
{%- set reasoning_content = message.reasoning_content %}
|
| 93 |
+
{%- else %}
|
| 94 |
+
{%- if '</think>' in content %}
|
| 95 |
+
{%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
|
| 96 |
+
{%- set content = content.split('</think>')[-1].lstrip('\n') %}
|
| 97 |
+
{%- endif %}
|
| 98 |
+
{%- endif %}
|
| 99 |
+
{%- set reasoning_content = reasoning_content|trim %}
|
| 100 |
+
{{- '<|im_start|>' + message.role + '\n' -}}
|
| 101 |
+
{% generation %}
|
| 102 |
+
{%- if loop.index0 > ns.last_query_index %}
|
| 103 |
+
{{- '<think>\n' + reasoning_content + '\n</think>\n\n' + content -}}
|
| 104 |
+
{%- else %}
|
| 105 |
+
{{- content -}}
|
| 106 |
+
{%- endif %}
|
| 107 |
+
{%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
|
| 108 |
+
{%- for tool_call in message.tool_calls %}
|
| 109 |
+
{%- if tool_call.function is defined %}
|
| 110 |
+
{%- set tool_call = tool_call.function %}
|
| 111 |
+
{%- endif %}
|
| 112 |
+
{%- if loop.first %}
|
| 113 |
+
{%- if content|trim %}
|
| 114 |
+
{{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 115 |
+
{%- else %}
|
| 116 |
+
{{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 117 |
+
{%- endif %}
|
| 118 |
+
{%- else %}
|
| 119 |
+
{{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
|
| 120 |
+
{%- endif %}
|
| 121 |
+
{%- if tool_call.arguments is defined %}
|
| 122 |
+
{%- for args_name, args_value in tool_call.arguments|items %}
|
| 123 |
+
{{- '<parameter=' + args_name + '>\n' }}
|
| 124 |
+
{%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
|
| 125 |
+
{{- args_value }}
|
| 126 |
+
{{- '\n</parameter>\n' }}
|
| 127 |
+
{%- endfor %}
|
| 128 |
+
{%- endif %}
|
| 129 |
+
{{- '</function>\n</tool_call>' }}
|
| 130 |
+
{%- endfor %}
|
| 131 |
+
{%- endif %}
|
| 132 |
+
{{- '<|im_end|>\n' }}
|
| 133 |
+
{%- endgeneration %}
|
| 134 |
+
{%- elif message.role == "tool" %}
|
| 135 |
+
{%- if loop.previtem and loop.previtem.role != "tool" %}
|
| 136 |
+
{{- '<|im_start|>user' }}
|
| 137 |
+
{%- endif %}
|
| 138 |
+
{{- '\n<tool_response>\n' }}
|
| 139 |
+
{{- content }}
|
| 140 |
+
{{- '\n</tool_response>' }}
|
| 141 |
+
{%- if not loop.last and loop.nextitem.role != "tool" %}
|
| 142 |
+
{{- '<|im_end|>\n' }}
|
| 143 |
+
{%- elif loop.last %}
|
| 144 |
+
{{- '<|im_end|>\n' }}
|
| 145 |
+
{%- endif %}
|
| 146 |
+
{%- else %}
|
| 147 |
+
{{- raise_exception('Unexpected message role.') }}
|
| 148 |
+
{%- endif %}
|
| 149 |
+
{%- endfor %}
|
| 150 |
+
{%- if add_generation_prompt %}
|
| 151 |
+
{{- '<|im_start|>assistant\n' }}
|
| 152 |
+
{%- if enable_thinking is defined and enable_thinking is true %}
|
| 153 |
+
{{- '<think>\n' }}
|
| 154 |
+
{%- else %}
|
| 155 |
+
{{- '<think>\n\n</think>\n\n' }}
|
| 156 |
+
{%- endif %}
|
| 157 |
+
{%- endif %}
|
botpsy-0.8b-q8_0/assets/tokenizer-06b9509352d2af50-tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523
|
| 3 |
+
size 19989325
|
botpsy-0.8b-q8_0/conversion-report.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b370dd18fe4f3f172eb0d3ad0768c8d3eff798d453ad0e2f12aacf22f9f9221b
|
| 3 |
+
size 175617
|
botpsy-0.8b-q8_0/manifest.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c518f079114101a82e37b2e85099c85d2fdf7416fb87785951c9dcfb1879bba
|
| 3 |
+
size 236885
|
botpsy-0.8b-q8_0/shard-000.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:328c0b0cdd059b0ab31bf901dd4914856307bbc3a4cc3e04c7d6496bbb540f0f
|
| 3 |
+
size 67107840
|
botpsy-0.8b-q8_0/shard-001.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:749c10cc94cb4f9fc103ce0763e7fe5d084053b690185b6f39fad38aec6ba255
|
| 3 |
+
size 67107840
|
botpsy-0.8b-q8_0/shard-002.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:203b2335de66f905803dbdf59d6f73e47410611fb924136f212becfd29d2cc44
|
| 3 |
+
size 67107840
|
botpsy-0.8b-q8_0/shard-003.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:54189bfc8a2bd700aae59b52af0ceb7acc0b1e4800261cd8c3b5acfff627fd42
|
| 3 |
+
size 67107840
|