Matjac5 commited on
Commit
87a2260
·
verified ·
1 Parent(s): be41d0f

Upload 13 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 1024,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": true,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": false,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,443 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - sentence-transformers
4
+ - sentence-similarity
5
+ - feature-extraction
6
+ - generated_from_trainer
7
+ - dataset_size:725795
8
+ - loss:MultipleNegativesRankingLoss
9
+ base_model: Qwen/Qwen3-0.6B-Base
10
+ widget:
11
+ - source_sentence: What swims to female reproductive organs for fertilization?
12
+ sentences:
13
+ - '93.2'
14
+ - male gametes
15
+ - Quadrangular membrane
16
+ - source_sentence: Items are all ultimately compromised of which?
17
+ sentences:
18
+ - triplets
19
+ - Molecules
20
+ - 2.5 cm
21
+ - source_sentence: Which one of the following statements about chromatin is not true?
22
+ sentences:
23
+ - multicellular
24
+ - Maple syrup urine disease
25
+ - H2A-H2B bind to both the entry and exit ends of DNA in nucleosomes
26
+ - source_sentence: 'Widal test is an example of.......... Test.:'
27
+ sentences:
28
+ - Agglutination
29
+ - water
30
+ - 150 m
31
+ - source_sentence: The ratio of an object's mass to its volume is its
32
+ sentences:
33
+ - density.
34
+ - 500 m
35
+ - Oculocardiac reflex
36
+ pipeline_tag: sentence-similarity
37
+ library_name: sentence-transformers
38
+ ---
39
+
40
+ # SentenceTransformer based on Qwen/Qwen3-0.6B-Base
41
+
42
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Qwen/Qwen3-0.6B-Base](https://huggingface.co/Qwen/Qwen3-0.6B-Base). It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
43
+
44
+ ## Model Details
45
+
46
+ ### Model Description
47
+ - **Model Type:** Sentence Transformer
48
+ - **Base model:** [Qwen/Qwen3-0.6B-Base](https://huggingface.co/Qwen/Qwen3-0.6B-Base) <!-- at revision 11214f7f3465775dcce23c3752ecea5a42ee0ddc -->
49
+ - **Maximum Sequence Length:** 128 tokens
50
+ - **Output Dimensionality:** 1024 dimensions
51
+ - **Similarity Function:** Cosine Similarity
52
+ <!-- - **Training Dataset:** Unknown -->
53
+ <!-- - **Language:** Unknown -->
54
+ <!-- - **License:** Unknown -->
55
+
56
+ ### Model Sources
57
+
58
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
59
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
60
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
61
+
62
+ ### Full Model Architecture
63
+
64
+ ```
65
+ SentenceTransformer(
66
+ (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: Qwen3Model
67
+ (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
68
+ )
69
+ ```
70
+
71
+ ## Usage
72
+
73
+ ### Direct Usage (Sentence Transformers)
74
+
75
+ First install the Sentence Transformers library:
76
+
77
+ ```bash
78
+ pip install -U sentence-transformers
79
+ ```
80
+
81
+ Then you can load this model and run inference.
82
+ ```python
83
+ from sentence_transformers import SentenceTransformer
84
+
85
+ # Download from the 🤗 Hub
86
+ model = SentenceTransformer("sentence_transformers_model_id")
87
+ # Run inference
88
+ sentences = [
89
+ "The ratio of an object's mass to its volume is its",
90
+ 'density.',
91
+ '500 m',
92
+ ]
93
+ embeddings = model.encode(sentences)
94
+ print(embeddings.shape)
95
+ # [3, 1024]
96
+
97
+ # Get the similarity scores for the embeddings
98
+ similarities = model.similarity(embeddings, embeddings)
99
+ print(similarities.shape)
100
+ # [3, 3]
101
+ ```
102
+
103
+ <!--
104
+ ### Direct Usage (Transformers)
105
+
106
+ <details><summary>Click to see the direct usage in Transformers</summary>
107
+
108
+ </details>
109
+ -->
110
+
111
+ <!--
112
+ ### Downstream Usage (Sentence Transformers)
113
+
114
+ You can finetune this model on your own dataset.
115
+
116
+ <details><summary>Click to expand</summary>
117
+
118
+ </details>
119
+ -->
120
+
121
+ <!--
122
+ ### Out-of-Scope Use
123
+
124
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
125
+ -->
126
+
127
+ <!--
128
+ ## Bias, Risks and Limitations
129
+
130
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
131
+ -->
132
+
133
+ <!--
134
+ ### Recommendations
135
+
136
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
137
+ -->
138
+
139
+ ## Training Details
140
+
141
+ ### Training Dataset
142
+
143
+ #### Unnamed Dataset
144
+
145
+ * Size: 725,795 training samples
146
+ * Columns: <code>sentence_0</code> and <code>sentence_1</code>
147
+ * Approximate statistics based on the first 1000 samples:
148
+ | | sentence_0 | sentence_1 |
149
+ |:--------|:-----------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|
150
+ | type | string | string |
151
+ | details | <ul><li>min: 3 tokens</li><li>mean: 36.99 tokens</li><li>max: 128 tokens</li></ul> | <ul><li>min: 1 tokens</li><li>mean: 4.56 tokens</li><li>max: 34 tokens</li></ul> |
152
+ * Samples:
153
+ | sentence_0 | sentence_1 |
154
+ |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------|
155
+ | <code>A balance can measure the weight of</code> | <code>sugar</code> |
156
+ | <code>The average monthly salary of 20 employees in an organisation is Rs. 1500. If the manager's salary is added, then the average salary increases by Rs. 100. What is the manager's monthly salary?</code> | <code>Rs.3600</code> |
157
+ | <code>When a baby shakes a rattle, it makes a noise. Which form of energy was changed to sound energy?</code> | <code>mechanical</code> |
158
+ * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
159
+ ```json
160
+ {
161
+ "scale": 20.0,
162
+ "similarity_fct": "cos_sim"
163
+ }
164
+ ```
165
+
166
+ ### Training Hyperparameters
167
+ #### Non-Default Hyperparameters
168
+
169
+ - `per_device_train_batch_size`: 16
170
+ - `per_device_eval_batch_size`: 16
171
+ - `num_train_epochs`: 1
172
+ - `fp16`: True
173
+ - `multi_dataset_batch_sampler`: round_robin
174
+
175
+ #### All Hyperparameters
176
+ <details><summary>Click to expand</summary>
177
+
178
+ - `overwrite_output_dir`: False
179
+ - `do_predict`: False
180
+ - `eval_strategy`: no
181
+ - `prediction_loss_only`: True
182
+ - `per_device_train_batch_size`: 16
183
+ - `per_device_eval_batch_size`: 16
184
+ - `per_gpu_train_batch_size`: None
185
+ - `per_gpu_eval_batch_size`: None
186
+ - `gradient_accumulation_steps`: 1
187
+ - `eval_accumulation_steps`: None
188
+ - `torch_empty_cache_steps`: None
189
+ - `learning_rate`: 5e-05
190
+ - `weight_decay`: 0.0
191
+ - `adam_beta1`: 0.9
192
+ - `adam_beta2`: 0.999
193
+ - `adam_epsilon`: 1e-08
194
+ - `max_grad_norm`: 1
195
+ - `num_train_epochs`: 1
196
+ - `max_steps`: -1
197
+ - `lr_scheduler_type`: linear
198
+ - `lr_scheduler_kwargs`: {}
199
+ - `warmup_ratio`: 0.0
200
+ - `warmup_steps`: 0
201
+ - `log_level`: passive
202
+ - `log_level_replica`: warning
203
+ - `log_on_each_node`: True
204
+ - `logging_nan_inf_filter`: True
205
+ - `save_safetensors`: True
206
+ - `save_on_each_node`: False
207
+ - `save_only_model`: False
208
+ - `restore_callback_states_from_checkpoint`: False
209
+ - `no_cuda`: False
210
+ - `use_cpu`: False
211
+ - `use_mps_device`: False
212
+ - `seed`: 42
213
+ - `data_seed`: None
214
+ - `jit_mode_eval`: False
215
+ - `use_ipex`: False
216
+ - `bf16`: False
217
+ - `fp16`: True
218
+ - `fp16_opt_level`: O1
219
+ - `half_precision_backend`: auto
220
+ - `bf16_full_eval`: False
221
+ - `fp16_full_eval`: False
222
+ - `tf32`: None
223
+ - `local_rank`: 0
224
+ - `ddp_backend`: None
225
+ - `tpu_num_cores`: None
226
+ - `tpu_metrics_debug`: False
227
+ - `debug`: []
228
+ - `dataloader_drop_last`: False
229
+ - `dataloader_num_workers`: 0
230
+ - `dataloader_prefetch_factor`: None
231
+ - `past_index`: -1
232
+ - `disable_tqdm`: False
233
+ - `remove_unused_columns`: True
234
+ - `label_names`: None
235
+ - `load_best_model_at_end`: False
236
+ - `ignore_data_skip`: False
237
+ - `fsdp`: []
238
+ - `fsdp_min_num_params`: 0
239
+ - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
240
+ - `fsdp_transformer_layer_cls_to_wrap`: None
241
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
242
+ - `deepspeed`: None
243
+ - `label_smoothing_factor`: 0.0
244
+ - `optim`: adamw_torch
245
+ - `optim_args`: None
246
+ - `adafactor`: False
247
+ - `group_by_length`: False
248
+ - `length_column_name`: length
249
+ - `ddp_find_unused_parameters`: None
250
+ - `ddp_bucket_cap_mb`: None
251
+ - `ddp_broadcast_buffers`: False
252
+ - `dataloader_pin_memory`: True
253
+ - `dataloader_persistent_workers`: False
254
+ - `skip_memory_metrics`: True
255
+ - `use_legacy_prediction_loop`: False
256
+ - `push_to_hub`: False
257
+ - `resume_from_checkpoint`: None
258
+ - `hub_model_id`: None
259
+ - `hub_strategy`: every_save
260
+ - `hub_private_repo`: None
261
+ - `hub_always_push`: False
262
+ - `gradient_checkpointing`: False
263
+ - `gradient_checkpointing_kwargs`: None
264
+ - `include_inputs_for_metrics`: False
265
+ - `include_for_metrics`: []
266
+ - `eval_do_concat_batches`: True
267
+ - `fp16_backend`: auto
268
+ - `push_to_hub_model_id`: None
269
+ - `push_to_hub_organization`: None
270
+ - `mp_parameters`:
271
+ - `auto_find_batch_size`: False
272
+ - `full_determinism`: False
273
+ - `torchdynamo`: None
274
+ - `ray_scope`: last
275
+ - `ddp_timeout`: 1800
276
+ - `torch_compile`: False
277
+ - `torch_compile_backend`: None
278
+ - `torch_compile_mode`: None
279
+ - `include_tokens_per_second`: False
280
+ - `include_num_input_tokens_seen`: False
281
+ - `neftune_noise_alpha`: None
282
+ - `optim_target_modules`: None
283
+ - `batch_eval_metrics`: False
284
+ - `eval_on_start`: False
285
+ - `use_liger_kernel`: False
286
+ - `eval_use_gather_object`: False
287
+ - `average_tokens_across_devices`: False
288
+ - `prompts`: None
289
+ - `batch_sampler`: batch_sampler
290
+ - `multi_dataset_batch_sampler`: round_robin
291
+
292
+ </details>
293
+
294
+ ### Training Logs
295
+ | Epoch | Step | Training Loss |
296
+ |:------:|:-----:|:-------------:|
297
+ | 0.0110 | 500 | 1.3593 |
298
+ | 0.0220 | 1000 | 0.8335 |
299
+ | 0.0331 | 1500 | 0.7774 |
300
+ | 0.0441 | 2000 | 0.7507 |
301
+ | 0.0551 | 2500 | 0.7108 |
302
+ | 0.0661 | 3000 | 0.6946 |
303
+ | 0.0772 | 3500 | 0.6644 |
304
+ | 0.0882 | 4000 | 0.621 |
305
+ | 0.0992 | 4500 | 0.6124 |
306
+ | 0.1102 | 5000 | 0.576 |
307
+ | 0.1212 | 5500 | 0.5787 |
308
+ | 0.1323 | 6000 | 0.5502 |
309
+ | 0.1433 | 6500 | 0.5653 |
310
+ | 0.1543 | 7000 | 0.5315 |
311
+ | 0.1653 | 7500 | 0.5198 |
312
+ | 0.1764 | 8000 | 0.5114 |
313
+ | 0.1874 | 8500 | 0.4775 |
314
+ | 0.1984 | 9000 | 0.4803 |
315
+ | 0.2094 | 9500 | 0.4876 |
316
+ | 0.2204 | 10000 | 0.4824 |
317
+ | 0.2315 | 10500 | 0.4587 |
318
+ | 0.2425 | 11000 | 0.4521 |
319
+ | 0.2535 | 11500 | 0.4565 |
320
+ | 0.2645 | 12000 | 0.448 |
321
+ | 0.2756 | 12500 | 0.4475 |
322
+ | 0.2866 | 13000 | 0.4313 |
323
+ | 0.2976 | 13500 | 0.4226 |
324
+ | 0.3086 | 14000 | 0.4079 |
325
+ | 0.3196 | 14500 | 0.3869 |
326
+ | 0.3307 | 15000 | 0.4001 |
327
+ | 0.3417 | 15500 | 0.3815 |
328
+ | 0.3527 | 16000 | 0.3769 |
329
+ | 0.3637 | 16500 | 0.3526 |
330
+ | 0.3748 | 17000 | 0.3839 |
331
+ | 0.3858 | 17500 | 0.3647 |
332
+ | 0.3968 | 18000 | 0.3616 |
333
+ | 0.4078 | 18500 | 0.3615 |
334
+ | 0.4188 | 19000 | 0.3592 |
335
+ | 0.4299 | 19500 | 0.322 |
336
+ | 0.4409 | 20000 | 0.3352 |
337
+ | 0.4519 | 20500 | 0.3228 |
338
+ | 0.4629 | 21000 | 0.3213 |
339
+ | 0.4740 | 21500 | 0.3129 |
340
+ | 0.4850 | 22000 | 0.3086 |
341
+ | 0.4960 | 22500 | 0.3011 |
342
+ | 0.5070 | 23000 | 0.3112 |
343
+ | 0.5180 | 23500 | 0.308 |
344
+ | 0.5291 | 24000 | 0.3002 |
345
+ | 0.5401 | 24500 | 0.2805 |
346
+ | 0.5511 | 25000 | 0.2809 |
347
+ | 0.5621 | 25500 | 0.2666 |
348
+ | 0.5732 | 26000 | 0.2772 |
349
+ | 0.5842 | 26500 | 0.2783 |
350
+ | 0.5952 | 27000 | 0.2704 |
351
+ | 0.6062 | 27500 | 0.2696 |
352
+ | 0.6172 | 28000 | 0.2667 |
353
+ | 0.6283 | 28500 | 0.2561 |
354
+ | 0.6393 | 29000 | 0.2546 |
355
+ | 0.6503 | 29500 | 0.2491 |
356
+ | 0.6613 | 30000 | 0.2405 |
357
+ | 0.6724 | 30500 | 0.2376 |
358
+ | 0.6834 | 31000 | 0.2236 |
359
+ | 0.6944 | 31500 | 0.246 |
360
+ | 0.7054 | 32000 | 0.2418 |
361
+ | 0.7164 | 32500 | 0.2271 |
362
+ | 0.7275 | 33000 | 0.2308 |
363
+ | 0.7385 | 33500 | 0.2162 |
364
+ | 0.7495 | 34000 | 0.2135 |
365
+ | 0.7605 | 34500 | 0.2157 |
366
+ | 0.7716 | 35000 | 0.2177 |
367
+ | 0.7826 | 35500 | 0.2242 |
368
+ | 0.7936 | 36000 | 0.22 |
369
+ | 0.8046 | 36500 | 0.2026 |
370
+ | 0.8156 | 37000 | 0.1988 |
371
+ | 0.8267 | 37500 | 0.1845 |
372
+ | 0.8377 | 38000 | 0.1955 |
373
+ | 0.8487 | 38500 | 0.2115 |
374
+ | 0.8597 | 39000 | 0.2026 |
375
+ | 0.8708 | 39500 | 0.1861 |
376
+ | 0.8818 | 40000 | 0.1882 |
377
+ | 0.8928 | 40500 | 0.1861 |
378
+ | 0.9038 | 41000 | 0.1921 |
379
+ | 0.9148 | 41500 | 0.1778 |
380
+ | 0.9259 | 42000 | 0.1779 |
381
+ | 0.9369 | 42500 | 0.1782 |
382
+ | 0.9479 | 43000 | 0.1748 |
383
+ | 0.9589 | 43500 | 0.168 |
384
+ | 0.9700 | 44000 | 0.1717 |
385
+ | 0.9810 | 44500 | 0.1699 |
386
+ | 0.9920 | 45000 | 0.1697 |
387
+
388
+
389
+ ### Framework Versions
390
+ - Python: 3.11.12
391
+ - Sentence Transformers: 4.1.0
392
+ - Transformers: 4.52.3
393
+ - PyTorch: 2.6.0+cu124
394
+ - Accelerate: 1.7.0
395
+ - Datasets: 3.6.0
396
+ - Tokenizers: 0.21.1
397
+
398
+ ## Citation
399
+
400
+ ### BibTeX
401
+
402
+ #### Sentence Transformers
403
+ ```bibtex
404
+ @inproceedings{reimers-2019-sentence-bert,
405
+ title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
406
+ author = "Reimers, Nils and Gurevych, Iryna",
407
+ booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
408
+ month = "11",
409
+ year = "2019",
410
+ publisher = "Association for Computational Linguistics",
411
+ url = "https://arxiv.org/abs/1908.10084",
412
+ }
413
+ ```
414
+
415
+ #### MultipleNegativesRankingLoss
416
+ ```bibtex
417
+ @misc{henderson2017efficient,
418
+ title={Efficient Natural Language Response Suggestion for Smart Reply},
419
+ author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
420
+ year={2017},
421
+ eprint={1705.00652},
422
+ archivePrefix={arXiv},
423
+ primaryClass={cs.CL}
424
+ }
425
+ ```
426
+
427
+ <!--
428
+ ## Glossary
429
+
430
+ *Clearly define terms in order to be accessible across audiences.*
431
+ -->
432
+
433
+ <!--
434
+ ## Model Card Authors
435
+
436
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
437
+ -->
438
+
439
+ <!--
440
+ ## Model Card Contact
441
+
442
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
443
+ -->
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
chat_template.jinja ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- if tools %}
2
+ {{- '<|im_start|>system\n' }}
3
+ {%- if messages[0].role == 'system' %}
4
+ {{- messages[0].content + '\n\n' }}
5
+ {%- endif %}
6
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
7
+ {%- for tool in tools %}
8
+ {{- "\n" }}
9
+ {{- tool | tojson }}
10
+ {%- endfor %}
11
+ {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
12
+ {%- else %}
13
+ {%- if messages[0].role == 'system' %}
14
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
15
+ {%- endif %}
16
+ {%- endif %}
17
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
18
+ {%- for message in messages[::-1] %}
19
+ {%- set index = (messages|length - 1) - loop.index0 %}
20
+ {%- if ns.multi_step_tool and message.role == "user" and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
21
+ {%- set ns.multi_step_tool = false %}
22
+ {%- set ns.last_query_index = index %}
23
+ {%- endif %}
24
+ {%- endfor %}
25
+ {%- for message in messages %}
26
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
27
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
28
+ {%- elif message.role == "assistant" %}
29
+ {%- set content = message.content %}
30
+ {%- set reasoning_content = '' %}
31
+ {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
32
+ {%- set reasoning_content = message.reasoning_content %}
33
+ {%- else %}
34
+ {%- if '</think>' in message.content %}
35
+ {%- set content = message.content.split('</think>')[-1].lstrip('\n') %}
36
+ {%- set reasoning_content = message.content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
37
+ {%- endif %}
38
+ {%- endif %}
39
+ {%- if loop.index0 > ns.last_query_index %}
40
+ {%- if loop.last or (not loop.last and reasoning_content) %}
41
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
42
+ {%- else %}
43
+ {{- '<|im_start|>' + message.role + '\n' + content }}
44
+ {%- endif %}
45
+ {%- else %}
46
+ {{- '<|im_start|>' + message.role + '\n' + content }}
47
+ {%- endif %}
48
+ {%- if message.tool_calls %}
49
+ {%- for tool_call in message.tool_calls %}
50
+ {%- if (loop.first and content) or (not loop.first) %}
51
+ {{- '\n' }}
52
+ {%- endif %}
53
+ {%- if tool_call.function %}
54
+ {%- set tool_call = tool_call.function %}
55
+ {%- endif %}
56
+ {{- '<tool_call>\n{"name": "' }}
57
+ {{- tool_call.name }}
58
+ {{- '", "arguments": ' }}
59
+ {%- if tool_call.arguments is string %}
60
+ {{- tool_call.arguments }}
61
+ {%- else %}
62
+ {{- tool_call.arguments | tojson }}
63
+ {%- endif %}
64
+ {{- '}\n</tool_call>' }}
65
+ {%- endfor %}
66
+ {%- endif %}
67
+ {{- '<|im_end|>\n' }}
68
+ {%- elif message.role == "tool" %}
69
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
70
+ {{- '<|im_start|>user' }}
71
+ {%- endif %}
72
+ {{- '\n<tool_response>\n' }}
73
+ {{- message.content }}
74
+ {{- '\n</tool_response>' }}
75
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
76
+ {{- '<|im_end|>\n' }}
77
+ {%- endif %}
78
+ {%- endif %}
79
+ {%- endfor %}
80
+ {%- if add_generation_prompt %}
81
+ {{- '<|im_start|>assistant\n' }}
82
+ {%- if enable_thinking is defined and enable_thinking is false %}
83
+ {{- '<think>\n\n</think>\n\n' }}
84
+ {%- endif %}
85
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3Model"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 151643,
8
+ "eos_token_id": 151643,
9
+ "head_dim": 128,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 1024,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 3072,
14
+ "max_position_embeddings": 32768,
15
+ "max_window_layers": 28,
16
+ "model_type": "qwen3",
17
+ "num_attention_heads": 16,
18
+ "num_hidden_layers": 28,
19
+ "num_key_value_heads": 8,
20
+ "rms_norm_eps": 1e-06,
21
+ "rope_scaling": null,
22
+ "rope_theta": 1000000,
23
+ "sliding_window": null,
24
+ "tie_word_embeddings": true,
25
+ "torch_dtype": "float32",
26
+ "transformers_version": "4.52.3",
27
+ "use_cache": true,
28
+ "use_sliding_window": false,
29
+ "vocab_size": 151936
30
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "4.1.0",
4
+ "transformers": "4.52.3",
5
+ "pytorch": "2.6.0+cu124"
6
+ },
7
+ "prompts": {},
8
+ "default_prompt_name": null,
9
+ "similarity_fn_name": "cosine"
10
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
modules.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ }
14
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 128,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|endoftext|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": {
25
+ "content": "<|endoftext|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c9573ae979ec2d2616f50161510156609a81f0842bbc4e8d1f161995c5cd8f4
3
+ size 11422920
tokenizer_config.json ADDED
@@ -0,0 +1,239 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>"
228
+ ],
229
+ "bos_token": null,
230
+ "clean_up_tokenization_spaces": false,
231
+ "eos_token": "<|endoftext|>",
232
+ "errors": "replace",
233
+ "extra_special_tokens": {},
234
+ "model_max_length": 128,
235
+ "pad_token": "<|endoftext|>",
236
+ "split_special_tokens": false,
237
+ "tokenizer_class": "Qwen2Tokenizer",
238
+ "unk_token": null
239
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff