Hugging Face's logo

fefofico
/
nuclear_trained_f2llm

Text Classification
setfit
Safetensors
sentence-transformers
qwen3
generated_from_setfit_trainer
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
fefofico commited on
Commit
fc3a41f
·
verified ·
1 Parent(s): 47b01b8

Push model using huggingface_hub.

Browse files
Files changed (17) hide show
  1. .gitattributes +1 -0
  2. 1_Pooling/config.json +10 -0
  3. README.md +511 -0
  4. added_tokens.json +28 -0
  5. chat_template.jinja +89 -0
  6. config.json +40 -0
  7. config_sentence_transformers.json +13 -0
  8. config_setfit.json +7 -0
  9. merges.txt +0 -0
  10. model.safetensors +3 -0
  11. model_head.pkl +3 -0
  12. modules.json +20 -0
  13. sentence_bert_config.json +4 -0
  14. special_tokens_map.json +31 -0
  15. tokenizer.json +3 -0
  16. tokenizer_config.json +239 -0
  17. vocab.json +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 1024,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": false,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": true,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,511 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - setfit
4
+ - sentence-transformers
5
+ - text-classification
6
+ - generated_from_setfit_trainer
7
+ widget:
8
+ - text: 'my question is this: for that price – less than 200 million euros, over ten
9
+ years, spread amongst 28 allies – how could we not agree to build defence for
10
+ all our citizens against missile attacks?'
11
+ - text: the essence of that document will be to find the appropriate mix between nuclear
12
+ forces, conventional forces and missile defence.
13
+ - text: and that we must find ways to encourage china to participate in arms control
14
+ arrangements.
15
+ - text: then, of course, you’re also expected to continue to increase defence spending
16
+ and to meet the pledge of spending 2 percent of gdp on defence.
17
+ - text: and among the new threats are missile attacks.
18
+ metrics:
19
+ - f1_macro
20
+ - f1_binary
21
+ pipeline_tag: text-classification
22
+ library_name: setfit
23
+ inference: true
24
+ base_model: codefuse-ai/F2LLM-v2-80M
25
+ model-index:
26
+ - name: SetFit with codefuse-ai/F2LLM-v2-80M
27
+ results:
28
+ - task:
29
+ type: text-classification
30
+ name: Text Classification
31
+ dataset:
32
+ name: Unknown
33
+ type: unknown
34
+ split: test
35
+ metrics:
36
+ - type: f1_macro
37
+ value: 0.9217613949895156
38
+ name: F1_Macro
39
+ - type: f1_binary
40
+ value: 0.9129411764705883
41
+ name: F1_Binary
42
+ ---
43
+
44
+ # SetFit with codefuse-ai/F2LLM-v2-80M
45
+
46
+ This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [codefuse-ai/F2LLM-v2-80M](https://huggingface.co/codefuse-ai/F2LLM-v2-80M) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
47
+
48
+ The model has been trained using an efficient few-shot learning technique that involves:
49
+
50
+ 1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
51
+ 2. Training a classification head with features from the fine-tuned Sentence Transformer.
52
+
53
+ ## Model Details
54
+
55
+ ### Model Description
56
+ - **Model Type:** SetFit
57
+ - **Sentence Transformer body:** [codefuse-ai/F2LLM-v2-80M](https://huggingface.co/codefuse-ai/F2LLM-v2-80M)
58
+ - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
59
+ - **Maximum Sequence Length:** 40960 tokens
60
+ - **Number of Classes:** 2 classes
61
+ <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
62
+ <!-- - **Language:** Unknown -->
63
+ <!-- - **License:** Unknown -->
64
+
65
+ ### Model Sources
66
+
67
+ - **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
68
+ - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
69
+ - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
70
+
71
+ ### Model Labels
72
+ | Label | Examples |
73
+ |:---------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
74
+ | negative | <ul><li>'only in the last five years, china has added 80 ships and submarines to its navy – the equivalent of the whole uk royal navy.'</li><li>'well, we discussed different missions and operations, and in general i always ask the netherlands to do more, because what they contribute is such high quality, and they are so well trained and well equipped when the netherlands deploy forces.'</li><li>"well, i cannot confirm the latest instance you're referring to but in general, i can say that we are stepping up our vigilance, our presence, the way we monitor our airspace and including by deploying new patriot batteries to the eastern part of the alliance and by doing that and also through our awacs surveillance planes and increased air policing, air patrolling, we are both increasing the capabilities we have to monitor, to track, but also to ensure that we are able to react if needed."</li></ul> |
75
+ | positive | <ul><li>'so the reason why we are where we are, is that the treaty that banned missiles - all intermediate range missiles, convention and nuclear - that treaty has collapsed.'</li><li>'let me also make use of this occasion to say that the annual nuclear exercise steadfast noon will start on monday, we will have more than 60 aircraft involved in training sessions.'</li><li>'as well as equipment to help ukraine protect against chemical, biological, radiological and nuclear threats.'</li></ul> |
76
+
77
+ ## Evaluation
78
+
79
+ ### Metrics
80
+ | Label | F1_Macro | F1_Binary |
81
+ |:--------|:---------|:----------|
82
+ | **all** | 0.9218 | 0.9129 |
83
+
84
+ ## Uses
85
+
86
+ ### Direct Use for Inference
87
+
88
+ First install the SetFit library:
89
+
90
+ ```bash
91
+ pip install setfit
92
+ ```
93
+
94
+ Then you can load this model and run inference.
95
+
96
+ ```python
97
+ from setfit import SetFitModel
98
+
99
+ # Download from the 🤗 Hub
100
+ model = SetFitModel.from_pretrained("fefofico/nuclear_trained_f2llm")
101
+ # Run inference
102
+ preds = model("and among the new threats are missile attacks.")
103
+ ```
104
+
105
+ <!--
106
+ ### Downstream Use
107
+
108
+ *List how someone could finetune this model on their own dataset.*
109
+ -->
110
+
111
+ <!--
112
+ ### Out-of-Scope Use
113
+
114
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
115
+ -->
116
+
117
+ <!--
118
+ ## Bias, Risks and Limitations
119
+
120
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
121
+ -->
122
+
123
+ <!--
124
+ ### Recommendations
125
+
126
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
127
+ -->
128
+
129
+ ## Training Details
130
+
131
+ ### Training Set Metrics
132
+ | Training set | Min | Median | Max |
133
+ |:-------------|:----|:--------|:----|
134
+ | Word count | 2 | 24.0685 | 244 |
135
+
136
+ | Label | Training Sample Count |
137
+ |:---------|:----------------------|
138
+ | negative | 1056 |
139
+ | positive | 857 |
140
+
141
+ ### Training Hyperparameters
142
+ - batch_size: (64, 64)
143
+ - num_epochs: (5, 5)
144
+ - max_steps: -1
145
+ - sampling_strategy: oversampling
146
+ - num_iterations: 20
147
+ - body_learning_rate: (1e-06, 1e-06)
148
+ - head_learning_rate: 0.003
149
+ - loss: CosineSimilarityLoss
150
+ - distance_metric: cosine_distance
151
+ - margin: 0.25
152
+ - end_to_end: False
153
+ - use_amp: False
154
+ - warmup_proportion: 0.1
155
+ - l2_weight: 0.01
156
+ - seed: 42
157
+ - eval_max_steps: -1
158
+ - load_best_model_at_end: False
159
+
160
+ ### Training Results
161
+ | Epoch | Step | Training Loss | Validation Loss |
162
+ |:------:|:----:|:-------------:|:---------------:|
163
+ | 0.0033 | 1 | 0.3926 | - |
164
+ | 0.0669 | 20 | 0.3743 | - |
165
+ | 0.0008 | 1 | 0.3659 | - |
166
+ | 0.0167 | 20 | 0.3851 | - |
167
+ | 0.0334 | 40 | 0.3678 | - |
168
+ | 0.0502 | 60 | 0.3512 | - |
169
+ | 0.0669 | 80 | 0.3533 | - |
170
+ | 0.0836 | 100 | 0.3568 | - |
171
+ | 0.1003 | 120 | 0.3487 | - |
172
+ | 0.1171 | 140 | 0.3419 | - |
173
+ | 0.1338 | 160 | 0.3007 | - |
174
+ | 0.1505 | 180 | 0.3007 | - |
175
+ | 0.1672 | 200 | 0.2867 | - |
176
+ | 0.1839 | 220 | 0.2829 | - |
177
+ | 0.2007 | 240 | 0.2699 | - |
178
+ | 0.2174 | 260 | 0.2674 | - |
179
+ | 0.2341 | 280 | 0.2613 | - |
180
+ | 0.2508 | 300 | 0.2642 | - |
181
+ | 0.2676 | 320 | 0.2568 | - |
182
+ | 0.2843 | 340 | 0.2586 | - |
183
+ | 0.3010 | 360 | 0.2453 | - |
184
+ | 0.3177 | 380 | 0.2431 | - |
185
+ | 0.3344 | 400 | 0.246 | - |
186
+ | 0.3512 | 420 | 0.2408 | - |
187
+ | 0.3679 | 440 | 0.2256 | - |
188
+ | 0.3846 | 460 | 0.2219 | - |
189
+ | 0.4013 | 480 | 0.2119 | - |
190
+ | 0.4181 | 500 | 0.2044 | - |
191
+ | 0.4348 | 520 | 0.2007 | - |
192
+ | 0.4515 | 540 | 0.1929 | - |
193
+ | 0.4682 | 560 | 0.1749 | - |
194
+ | 0.4849 | 580 | 0.1826 | - |
195
+ | 0.5017 | 600 | 0.1699 | - |
196
+ | 0.5184 | 620 | 0.1799 | - |
197
+ | 0.5351 | 640 | 0.1492 | - |
198
+ | 0.5518 | 660 | 0.1487 | - |
199
+ | 0.5686 | 680 | 0.1466 | - |
200
+ | 0.5853 | 700 | 0.1408 | - |
201
+ | 0.6020 | 720 | 0.1368 | - |
202
+ | 0.6187 | 740 | 0.1343 | - |
203
+ | 0.6355 | 760 | 0.132 | - |
204
+ | 0.6522 | 780 | 0.1145 | - |
205
+ | 0.6689 | 800 | 0.119 | - |
206
+ | 0.6856 | 820 | 0.1174 | - |
207
+ | 0.7023 | 840 | 0.1033 | - |
208
+ | 0.7191 | 860 | 0.0939 | - |
209
+ | 0.7358 | 880 | 0.1053 | - |
210
+ | 0.7525 | 900 | 0.088 | - |
211
+ | 0.7692 | 920 | 0.0867 | - |
212
+ | 0.7860 | 940 | 0.0943 | - |
213
+ | 0.8027 | 960 | 0.0889 | - |
214
+ | 0.8194 | 980 | 0.0767 | - |
215
+ | 0.8361 | 1000 | 0.0837 | - |
216
+ | 0.8528 | 1020 | 0.0751 | - |
217
+ | 0.8696 | 1040 | 0.0663 | - |
218
+ | 0.8863 | 1060 | 0.0669 | - |
219
+ | 0.9030 | 1080 | 0.0558 | - |
220
+ | 0.9197 | 1100 | 0.0466 | - |
221
+ | 0.9365 | 1120 | 0.0445 | - |
222
+ | 0.9532 | 1140 | 0.0505 | - |
223
+ | 0.9699 | 1160 | 0.038 | - |
224
+ | 0.9866 | 1180 | 0.039 | - |
225
+ | 1.0 | 1196 | - | 0.1151 |
226
+ | 1.0033 | 1200 | 0.0381 | - |
227
+ | 1.0201 | 1220 | 0.0311 | - |
228
+ | 1.0368 | 1240 | 0.0261 | - |
229
+ | 1.0535 | 1260 | 0.0268 | - |
230
+ | 1.0702 | 1280 | 0.0278 | - |
231
+ | 1.0870 | 1300 | 0.0259 | - |
232
+ | 1.1037 | 1320 | 0.0232 | - |
233
+ | 1.1204 | 1340 | 0.0184 | - |
234
+ | 1.1371 | 1360 | 0.0155 | - |
235
+ | 1.1538 | 1380 | 0.0144 | - |
236
+ | 1.1706 | 1400 | 0.0149 | - |
237
+ | 1.1873 | 1420 | 0.0166 | - |
238
+ | 1.2040 | 1440 | 0.0114 | - |
239
+ | 1.2207 | 1460 | 0.0118 | - |
240
+ | 1.2375 | 1480 | 0.0058 | - |
241
+ | 1.2542 | 1500 | 0.0123 | - |
242
+ | 1.2709 | 1520 | 0.0095 | - |
243
+ | 1.2876 | 1540 | 0.0118 | - |
244
+ | 1.3043 | 1560 | 0.0112 | - |
245
+ | 1.3211 | 1580 | 0.0058 | - |
246
+ | 1.3378 | 1600 | 0.0084 | - |
247
+ | 1.3545 | 1620 | 0.0091 | - |
248
+ | 1.3712 | 1640 | 0.0112 | - |
249
+ | 1.3880 | 1660 | 0.0076 | - |
250
+ | 1.4047 | 1680 | 0.008 | - |
251
+ | 1.4214 | 1700 | 0.0075 | - |
252
+ | 1.4381 | 1720 | 0.0072 | - |
253
+ | 1.4548 | 1740 | 0.0054 | - |
254
+ | 1.4716 | 1760 | 0.004 | - |
255
+ | 1.4883 | 1780 | 0.0068 | - |
256
+ | 1.5050 | 1800 | 0.0029 | - |
257
+ | 1.5217 | 1820 | 0.0045 | - |
258
+ | 1.5385 | 1840 | 0.0046 | - |
259
+ | 1.5552 | 1860 | 0.0039 | - |
260
+ | 1.5719 | 1880 | 0.0027 | - |
261
+ | 1.5886 | 1900 | 0.007 | - |
262
+ | 1.6054 | 1920 | 0.0041 | - |
263
+ | 1.6221 | 1940 | 0.0031 | - |
264
+ | 1.6388 | 1960 | 0.0027 | - |
265
+ | 1.6555 | 1980 | 0.0019 | - |
266
+ | 1.6722 | 2000 | 0.0043 | - |
267
+ | 1.6890 | 2020 | 0.0031 | - |
268
+ | 1.7057 | 2040 | 0.0044 | - |
269
+ | 1.7224 | 2060 | 0.001 | - |
270
+ | 1.7391 | 2080 | 0.0016 | - |
271
+ | 1.7559 | 2100 | 0.0047 | - |
272
+ | 1.7726 | 2120 | 0.0086 | - |
273
+ | 1.7893 | 2140 | 0.0017 | - |
274
+ | 1.8060 | 2160 | 0.0032 | - |
275
+ | 1.8227 | 2180 | 0.0069 | - |
276
+ | 1.8395 | 2200 | 0.0052 | - |
277
+ | 1.8562 | 2220 | 0.0052 | - |
278
+ | 1.8729 | 2240 | 0.0037 | - |
279
+ | 1.8896 | 2260 | 0.0054 | - |
280
+ | 1.9064 | 2280 | 0.0036 | - |
281
+ | 1.9231 | 2300 | 0.0043 | - |
282
+ | 1.9398 | 2320 | 0.0029 | - |
283
+ | 1.9565 | 2340 | 0.0042 | - |
284
+ | 1.9732 | 2360 | 0.0021 | - |
285
+ | 1.9900 | 2380 | 0.0045 | - |
286
+ | 2.0 | 2392 | - | 0.1276 |
287
+ | 2.0067 | 2400 | 0.002 | - |
288
+ | 2.0234 | 2420 | 0.0056 | - |
289
+ | 2.0401 | 2440 | 0.0044 | - |
290
+ | 2.0569 | 2460 | 0.0016 | - |
291
+ | 2.0736 | 2480 | 0.0024 | - |
292
+ | 2.0903 | 2500 | 0.0022 | - |
293
+ | 2.1070 | 2520 | 0.0061 | - |
294
+ | 2.1237 | 2540 | 0.0022 | - |
295
+ | 2.1405 | 2560 | 0.0006 | - |
296
+ | 2.1572 | 2580 | 0.0044 | - |
297
+ | 2.1739 | 2600 | 0.0038 | - |
298
+ | 2.1906 | 2620 | 0.0034 | - |
299
+ | 2.2074 | 2640 | 0.0027 | - |
300
+ | 2.2241 | 2660 | 0.002 | - |
301
+ | 2.2408 | 2680 | 0.0034 | - |
302
+ | 2.2575 | 2700 | 0.0028 | - |
303
+ | 2.2742 | 2720 | 0.0026 | - |
304
+ | 2.2910 | 2740 | 0.0026 | - |
305
+ | 2.3077 | 2760 | 0.0026 | - |
306
+ | 2.3244 | 2780 | 0.0027 | - |
307
+ | 2.3411 | 2800 | 0.0019 | - |
308
+ | 2.3579 | 2820 | 0.0026 | - |
309
+ | 2.3746 | 2840 | 0.0019 | - |
310
+ | 2.3913 | 2860 | 0.0028 | - |
311
+ | 2.4080 | 2880 | 0.0024 | - |
312
+ | 2.4247 | 2900 | 0.0011 | - |
313
+ | 2.4415 | 2920 | 0.0005 | - |
314
+ | 2.4582 | 2940 | 0.0024 | - |
315
+ | 2.4749 | 2960 | 0.0009 | - |
316
+ | 2.4916 | 2980 | 0.0015 | - |
317
+ | 2.5084 | 3000 | 0.0028 | - |
318
+ | 2.5251 | 3020 | 0.0019 | - |
319
+ | 2.5418 | 3040 | 0.0012 | - |
320
+ | 2.5585 | 3060 | 0.0004 | - |
321
+ | 2.5753 | 3080 | 0.0004 | - |
322
+ | 2.5920 | 3100 | 0.0004 | - |
323
+ | 2.6087 | 3120 | 0.0019 | - |
324
+ | 2.6254 | 3140 | 0.0042 | - |
325
+ | 2.6421 | 3160 | 0.0003 | - |
326
+ | 2.6589 | 3180 | 0.0003 | - |
327
+ | 2.6756 | 3200 | 0.0011 | - |
328
+ | 2.6923 | 3220 | 0.0026 | - |
329
+ | 2.7090 | 3240 | 0.0003 | - |
330
+ | 2.7258 | 3260 | 0.0026 | - |
331
+ | 2.7425 | 3280 | 0.0018 | - |
332
+ | 2.7592 | 3300 | 0.0011 | - |
333
+ | 2.7759 | 3320 | 0.0003 | - |
334
+ | 2.7926 | 3340 | 0.0017 | - |
335
+ | 2.8094 | 3360 | 0.0003 | - |
336
+ | 2.8261 | 3380 | 0.001 | - |
337
+ | 2.8428 | 3400 | 0.0003 | - |
338
+ | 2.8595 | 3420 | 0.0026 | - |
339
+ | 2.8763 | 3440 | 0.001 | - |
340
+ | 2.8930 | 3460 | 0.0011 | - |
341
+ | 2.9097 | 3480 | 0.001 | - |
342
+ | 2.9264 | 3500 | 0.0003 | - |
343
+ | 2.9431 | 3520 | 0.001 | - |
344
+ | 2.9599 | 3540 | 0.0003 | - |
345
+ | 2.9766 | 3560 | 0.0011 | - |
346
+ | 2.9933 | 3580 | 0.0002 | - |
347
+ | 3.0 | 3588 | - | 0.1319 |
348
+ | 3.0100 | 3600 | 0.001 | - |
349
+ | 3.0268 | 3620 | 0.0003 | - |
350
+ | 3.0435 | 3640 | 0.0002 | - |
351
+ | 3.0602 | 3660 | 0.0025 | - |
352
+ | 3.0769 | 3680 | 0.001 | - |
353
+ | 3.0936 | 3700 | 0.0002 | - |
354
+ | 3.1104 | 3720 | 0.0003 | - |
355
+ | 3.1271 | 3740 | 0.001 | - |
356
+ | 3.1438 | 3760 | 0.0002 | - |
357
+ | 3.1605 | 3780 | 0.0025 | - |
358
+ | 3.1773 | 3800 | 0.001 | - |
359
+ | 3.1940 | 3820 | 0.0025 | - |
360
+ | 3.2107 | 3840 | 0.0018 | - |
361
+ | 3.2274 | 3860 | 0.0002 | - |
362
+ | 3.2441 | 3880 | 0.0002 | - |
363
+ | 3.2609 | 3900 | 0.001 | - |
364
+ | 3.2776 | 3920 | 0.0032 | - |
365
+ | 3.2943 | 3940 | 0.0017 | - |
366
+ | 3.3110 | 3960 | 0.0009 | - |
367
+ | 3.3278 | 3980 | 0.0017 | - |
368
+ | 3.3445 | 4000 | 0.001 | - |
369
+ | 3.3612 | 4020 | 0.001 | - |
370
+ | 3.3779 | 4040 | 0.001 | - |
371
+ | 3.3946 | 4060 | 0.0024 | - |
372
+ | 3.4114 | 4080 | 0.0002 | - |
373
+ | 3.4281 | 4100 | 0.0002 | - |
374
+ | 3.4448 | 4120 | 0.001 | - |
375
+ | 3.4615 | 4140 | 0.0009 | - |
376
+ | 3.4783 | 4160 | 0.0002 | - |
377
+ | 3.4950 | 4180 | 0.0002 | - |
378
+ | 3.5117 | 4200 | 0.0018 | - |
379
+ | 3.5284 | 4220 | 0.0002 | - |
380
+ | 3.5452 | 4240 | 0.001 | - |
381
+ | 3.5619 | 4260 | 0.0009 | - |
382
+ | 3.5786 | 4280 | 0.0002 | - |
383
+ | 3.5953 | 4300 | 0.0002 | - |
384
+ | 3.6120 | 4320 | 0.0002 | - |
385
+ | 3.6288 | 4340 | 0.0017 | - |
386
+ | 3.6455 | 4360 | 0.0009 | - |
387
+ | 3.6622 | 4380 | 0.0024 | - |
388
+ | 3.6789 | 4400 | 0.0002 | - |
389
+ | 3.6957 | 4420 | 0.0025 | - |
390
+ | 3.7124 | 4440 | 0.0032 | - |
391
+ | 3.7291 | 4460 | 0.0009 | - |
392
+ | 3.7458 | 4480 | 0.0002 | - |
393
+ | 3.7625 | 4500 | 0.0009 | - |
394
+ | 3.7793 | 4520 | 0.0009 | - |
395
+ | 3.7960 | 4540 | 0.0002 | - |
396
+ | 3.8127 | 4560 | 0.0009 | - |
397
+ | 3.8294 | 4580 | 0.0024 | - |
398
+ | 3.8462 | 4600 | 0.0009 | - |
399
+ | 3.8629 | 4620 | 0.0002 | - |
400
+ | 3.8796 | 4640 | 0.0009 | - |
401
+ | 3.8963 | 4660 | 0.0009 | - |
402
+ | 3.9130 | 4680 | 0.0002 | - |
403
+ | 3.9298 | 4700 | 0.0002 | - |
404
+ | 3.9465 | 4720 | 0.0017 | - |
405
+ | 3.9632 | 4740 | 0.0002 | - |
406
+ | 3.9799 | 4760 | 0.0002 | - |
407
+ | 3.9967 | 4780 | 0.0016 | - |
408
+ | 4.0 | 4784 | - | 0.1343 |
409
+ | 4.0134 | 4800 | 0.0039 | - |
410
+ | 4.0301 | 4820 | 0.0009 | - |
411
+ | 4.0468 | 4840 | 0.0002 | - |
412
+ | 4.0635 | 4860 | 0.0002 | - |
413
+ | 4.0803 | 4880 | 0.0002 | - |
414
+ | 4.0970 | 4900 | 0.0002 | - |
415
+ | 4.1137 | 4920 | 0.0001 | - |
416
+ | 4.1304 | 4940 | 0.0032 | - |
417
+ | 4.1472 | 4960 | 0.0001 | - |
418
+ | 4.1639 | 4980 | 0.0002 | - |
419
+ | 4.1806 | 5000 | 0.0001 | - |
420
+ | 4.1973 | 5020 | 0.0024 | - |
421
+ | 4.2140 | 5040 | 0.0009 | - |
422
+ | 4.2308 | 5060 | 0.0001 | - |
423
+ | 4.2475 | 5080 | 0.0009 | - |
424
+ | 4.2642 | 5100 | 0.0001 | - |
425
+ | 4.2809 | 5120 | 0.0001 | - |
426
+ | 4.2977 | 5140 | 0.0009 | - |
427
+ | 4.3144 | 5160 | 0.0009 | - |
428
+ | 4.3311 | 5180 | 0.0024 | - |
429
+ | 4.3478 | 5200 | 0.0001 | - |
430
+ | 4.3645 | 5220 | 0.0009 | - |
431
+ | 4.3813 | 5240 | 0.0016 | - |
432
+ | 4.3980 | 5260 | 0.0001 | - |
433
+ | 4.4147 | 5280 | 0.0016 | - |
434
+ | 4.4314 | 5300 | 0.0016 | - |
435
+ | 4.4482 | 5320 | 0.0016 | - |
436
+ | 4.4649 | 5340 | 0.0008 | - |
437
+ | 4.4816 | 5360 | 0.0001 | - |
438
+ | 4.4983 | 5380 | 0.0001 | - |
439
+ | 4.5151 | 5400 | 0.0016 | - |
440
+ | 4.5318 | 5420 | 0.0009 | - |
441
+ | 4.5485 | 5440 | 0.0001 | - |
442
+ | 4.5652 | 5460 | 0.0002 | - |
443
+ | 4.5819 | 5480 | 0.0001 | - |
444
+ | 4.5987 | 5500 | 0.0024 | - |
445
+ | 4.6154 | 5520 | 0.0024 | - |
446
+ | 4.6321 | 5540 | 0.0001 | - |
447
+ | 4.6488 | 5560 | 0.0016 | - |
448
+ | 4.6656 | 5580 | 0.0016 | - |
449
+ | 4.6823 | 5600 | 0.0009 | - |
450
+ | 4.6990 | 5620 | 0.0009 | - |
451
+ | 4.7157 | 5640 | 0.0009 | - |
452
+ | 4.7324 | 5660 | 0.0016 | - |
453
+ | 4.7492 | 5680 | 0.0001 | - |
454
+ | 4.7659 | 5700 | 0.0001 | - |
455
+ | 4.7826 | 5720 | 0.0001 | - |
456
+ | 4.7993 | 5740 | 0.0009 | - |
457
+ | 4.8161 | 5760 | 0.0009 | - |
458
+ | 4.8328 | 5780 | 0.0001 | - |
459
+ | 4.8495 | 5800 | 0.0016 | - |
460
+ | 4.8662 | 5820 | 0.0017 | - |
461
+ | 4.8829 | 5840 | 0.0009 | - |
462
+ | 4.8997 | 5860 | 0.0009 | - |
463
+ | 4.9164 | 5880 | 0.0024 | - |
464
+ | 4.9331 | 5900 | 0.0009 | - |
465
+ | 4.9498 | 5920 | 0.0009 | - |
466
+ | 4.9666 | 5940 | 0.0016 | - |
467
+ | 4.9833 | 5960 | 0.0001 | - |
468
+ | 5.0 | 5980 | 0.0023 | 0.1340 |
469
+
470
+ ### Framework Versions
471
+ - Python: 3.12.13
472
+ - SetFit: 1.1.3
473
+ - Sentence Transformers: 3.4.1
474
+ - Transformers: 4.57.6
475
+ - PyTorch: 2.11.0+cu128
476
+ - Datasets: 5.0.0
477
+ - Tokenizers: 0.22.2
478
+
479
+ ## Citation
480
+
481
+ ### BibTeX
482
+ ```bibtex
483
+ @article{https://doi.org/10.48550/arxiv.2209.11055,
484
+ doi = {10.48550/ARXIV.2209.11055},
485
+ url = {https://arxiv.org/abs/2209.11055},
486
+ author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
487
+ keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
488
+ title = {Efficient Few-Shot Learning Without Prompts},
489
+ publisher = {arXiv},
490
+ year = {2022},
491
+ copyright = {Creative Commons Attribution 4.0 International}
492
+ }
493
+ ```
494
+
495
+ <!--
496
+ ## Glossary
497
+
498
+ *Clearly define terms in order to be accessible across audiences.*
499
+ -->
500
+
501
+ <!--
502
+ ## Model Card Authors
503
+
504
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
505
+ -->
506
+
507
+ <!--
508
+ ## Model Card Contact
509
+
510
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
511
+ -->
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
chat_template.jinja ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- if tools %}
2
+ {{- '<|im_start|>system\n' }}
3
+ {%- if messages[0].role == 'system' %}
4
+ {{- messages[0].content + '\n\n' }}
5
+ {%- endif %}
6
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
7
+ {%- for tool in tools %}
8
+ {{- "\n" }}
9
+ {{- tool | tojson }}
10
+ {%- endfor %}
11
+ {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
12
+ {%- else %}
13
+ {%- if messages[0].role == 'system' %}
14
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
15
+ {%- endif %}
16
+ {%- endif %}
17
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
18
+ {%- for message in messages[::-1] %}
19
+ {%- set index = (messages|length - 1) - loop.index0 %}
20
+ {%- if ns.multi_step_tool and message.role == "user" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
21
+ {%- set ns.multi_step_tool = false %}
22
+ {%- set ns.last_query_index = index %}
23
+ {%- endif %}
24
+ {%- endfor %}
25
+ {%- for message in messages %}
26
+ {%- if message.content is string %}
27
+ {%- set content = message.content %}
28
+ {%- else %}
29
+ {%- set content = '' %}
30
+ {%- endif %}
31
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
32
+ {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
33
+ {%- elif message.role == "assistant" %}
34
+ {%- set reasoning_content = '' %}
35
+ {%- if message.reasoning_content is string %}
36
+ {%- set reasoning_content = message.reasoning_content %}
37
+ {%- else %}
38
+ {%- if '</think>' in content %}
39
+ {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
40
+ {%- set content = content.split('</think>')[-1].lstrip('\n') %}
41
+ {%- endif %}
42
+ {%- endif %}
43
+ {%- if loop.index0 > ns.last_query_index %}
44
+ {%- if loop.last or (not loop.last and reasoning_content) %}
45
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
46
+ {%- else %}
47
+ {{- '<|im_start|>' + message.role + '\n' + content }}
48
+ {%- endif %}
49
+ {%- else %}
50
+ {{- '<|im_start|>' + message.role + '\n' + content }}
51
+ {%- endif %}
52
+ {%- if message.tool_calls %}
53
+ {%- for tool_call in message.tool_calls %}
54
+ {%- if (loop.first and content) or (not loop.first) %}
55
+ {{- '\n' }}
56
+ {%- endif %}
57
+ {%- if tool_call.function %}
58
+ {%- set tool_call = tool_call.function %}
59
+ {%- endif %}
60
+ {{- '<tool_call>\n{"name": "' }}
61
+ {{- tool_call.name }}
62
+ {{- '", "arguments": ' }}
63
+ {%- if tool_call.arguments is string %}
64
+ {{- tool_call.arguments }}
65
+ {%- else %}
66
+ {{- tool_call.arguments | tojson }}
67
+ {%- endif %}
68
+ {{- '}\n</tool_call>' }}
69
+ {%- endfor %}
70
+ {%- endif %}
71
+ {{- '<|im_end|>\n' }}
72
+ {%- elif message.role == "tool" %}
73
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
74
+ {{- '<|im_start|>user' }}
75
+ {%- endif %}
76
+ {{- '\n<tool_response>\n' }}
77
+ {{- content }}
78
+ {{- '\n</tool_response>' }}
79
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
80
+ {{- '<|im_end|>\n' }}
81
+ {%- endif %}
82
+ {%- endif %}
83
+ {%- endfor %}
84
+ {%- if add_generation_prompt %}
85
+ {{- '<|im_start|>assistant\n' }}
86
+ {%- if enable_thinking is defined and enable_thinking is false %}
87
+ {{- '<think>\n\n</think>\n\n' }}
88
+ {%- endif %}
89
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3Model"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 151643,
8
+ "dtype": "float32",
9
+ "eos_token_id": 151645,
10
+ "head_dim": 128,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 320,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 2048,
15
+ "layer_types": [
16
+ "full_attention",
17
+ "full_attention",
18
+ "full_attention",
19
+ "full_attention",
20
+ "full_attention",
21
+ "full_attention",
22
+ "full_attention",
23
+ "full_attention"
24
+ ],
25
+ "max_position_embeddings": 40960,
26
+ "max_window_layers": 8,
27
+ "model_type": "qwen3",
28
+ "num_attention_heads": 16,
29
+ "num_hidden_layers": 8,
30
+ "num_key_value_heads": 8,
31
+ "rms_norm_eps": 1e-06,
32
+ "rope_scaling": null,
33
+ "rope_theta": 1000000,
34
+ "sliding_window": null,
35
+ "tie_word_embeddings": true,
36
+ "transformers_version": "4.57.6",
37
+ "use_cache": false,
38
+ "use_sliding_window": false,
39
+ "vocab_size": 151936
40
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "prompts": {
3
+ "query": "Instruct: Given a question, retrieve passages that can help answer the question.\nQuery: ",
4
+ "document": ""
5
+ },
6
+ "default_prompt_name": null,
7
+ "similarity_fn_name": "cosine",
8
+ "__version__": {
9
+ "sentence_transformers": "3.4.1",
10
+ "transformers": "4.57.6",
11
+ "pytorch": "2.11.0+cu128"
12
+ }
13
+ }
config_setfit.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "labels": [
3
+ "negative",
4
+ "positive"
5
+ ],
6
+ "normalize_embeddings": false
7
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e7f2a53d75d3dbbc570313e4f59ce2ac2cfee637aabcb96c4a1ef5c02ed404b
3
+ size 320346592
model_head.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aac05693f4735843b81e58f46bcadd0cb723b419d2790d01d681e8e7e1dd560
3
+ size 2139
modules.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ },
14
+ {
15
+ "idx": 2,
16
+ "name": "2",
17
+ "path": "2_Normalize",
18
+ "type": "sentence_transformers.models.Normalize"
19
+ }
20
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 40960,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|im_end|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": {
25
+ "content": "<|endoftext|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a759ec3cc00c60c9e37bdff475d6a27ea22c71622497428a033b25eead1cc88
3
+ size 11423463
tokenizer_config.json ADDED
@@ -0,0 +1,239 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>"
228
+ ],
229
+ "bos_token": null,
230
+ "clean_up_tokenization_spaces": false,
231
+ "eos_token": "<|im_end|>",
232
+ "errors": "replace",
233
+ "extra_special_tokens": {},
234
+ "model_max_length": 131072,
235
+ "pad_token": "<|endoftext|>",
236
+ "split_special_tokens": false,
237
+ "tokenizer_class": "Qwen2Tokenizer",
238
+ "unk_token": null
239
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff