Hugging Face's logo

Backup-bdg
/
Xoron-Dev-MultiMoe

Any-to-Any
Transformers
Safetensors
English
xoron
multimodal
Mixture of Experts
text-to-image
image editing
image to video
text-to-video
video editing
text-to-speech
speech-to-text
speech-to-speech
image-to-text
video-to-text
agentic
tool-use
flow-matching
3d-rope
titok
vidtok
dual-stream-attention
zero-shot-voice-cloning
bigvgan
snake-activation
multi-receptive-field-fusion
custom_code
Model card Files
xet
 Community
1
Backup-bdg commited on
Commit
c3b1f1c
·
verified ·
1 Parent(s): ea67b5b

Update model weights after training (epoch 1, loss 5.7691)

Browse files
Files changed (22) hide show
  1. added_tokens.json +559 -0
  2. audio_decoder.safetensors +2 -2
  3. audio_encoder.safetensors +2 -2
  4. audio_projector.safetensors +2 -2
  5. cross_attention.safetensors +2 -2
  6. generator.safetensors +2 -2
  7. llm.safetensors +2 -2
  8. merges.txt +0 -0
  9. modality_markers.safetensors +0 -0
  10. projector.safetensors +2 -2
  11. special_tokens.json +134 -0
  12. special_tokens_map.json +3801 -0
  13. streaming_state.json +39 -0
  14. tokenizer.json +2 -2
  15. tokenizer_config.json +0 -0
  16. trainer_state.json +33 -0
  17. training_state.pt +3 -0
  18. video_encoder.safetensors +2 -2
  19. video_generator.safetensors +2 -2
  20. vision_encoder.safetensors +2 -2
  21. vocab.json +0 -0
  22. waveform_decoder.safetensors +2 -2
added_tokens.json ADDED
@@ -0,0 +1,559 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</tool_call>": 151658,
3
+ "<tool_call>": 151657,
4
+ "<|...|>": 152196,
5
+ "<|/action|>": 151830,
6
+ "<|/add_file|>": 151752,
7
+ "<|/adlib|>": 152110,
8
+ "<|/analysis|>": 151930,
9
+ "<|/arg_name|>": 151852,
10
+ "<|/arg_value|>": 151854,
11
+ "<|/arousal|>": 152020,
12
+ "<|/assistant|>": 151679,
13
+ "<|/attribution|>": 151975,
14
+ "<|/audio_prompt|>": 151995,
15
+ "<|/audio|>": 151993,
16
+ "<|/available_tools|>": 151860,
17
+ "<|/bbox|>": 151836,
18
+ "<|/beatbox|>": 152076,
19
+ "<|/branch|>": 151716,
20
+ "<|/breakdown|>": 151932,
21
+ "<|/bridge|>": 152074,
22
+ "<|/cell|>": 152137,
23
+ "<|/certainty_score|>": 151950,
24
+ "<|/changelog|>": 152156,
25
+ "<|/chant|>": 152044,
26
+ "<|/chorus|>": 152072,
27
+ "<|/cite|>": 151967,
28
+ "<|/code|>": 151883,
29
+ "<|/commit_after|>": 151703,
30
+ "<|/commit_before|>": 151701,
31
+ "<|/commit_msg|>": 151705,
32
+ "<|/conclusion|>": 151920,
33
+ "<|/condensed|>": 151689,
34
+ "<|/constraint|>": 152184,
35
+ "<|/context|>": 151977,
36
+ "<|/conv_history|>": 151699,
37
+ "<|/correction|>": 151963,
38
+ "<|/critique|>": 151926,
39
+ "<|/csv|>": 152164,
40
+ "<|/decision|>": 151934,
41
+ "<|/delete_file|>": 151754,
42
+ "<|/diff|>": 151707,
43
+ "<|/doc|>": 151782,
44
+ "<|/dominance|>": 152024,
45
+ "<|/draft|>": 152129,
46
+ "<|/edit_file|>": 151758,
47
+ "<|/edit_range|>": 151764,
48
+ "<|/emotion|>": 152018,
49
+ "<|/event|>": 151832,
50
+ "<|/example|>": 152186,
51
+ "<|/exec_error|>": 151749,
52
+ "<|/exec_result|>": 151747,
53
+ "<|/exec|>": 151745,
54
+ "<|/expected|>": 152192,
55
+ "<|/falsetto|>": 152093,
56
+ "<|/field|>": 152145,
57
+ "<|/file:css|>": 151797,
58
+ "<|/file:csv|>": 151799,
59
+ "<|/file:html|>": 151795,
60
+ "<|/file:ini|>": 151803,
61
+ "<|/file:json|>": 151789,
62
+ "<|/file:log|>": 151805,
63
+ "<|/file:md|>": 151787,
64
+ "<|/file:toml|>": 151801,
65
+ "<|/file:txt|>": 151785,
66
+ "<|/file:xml|>": 151791,
67
+ "<|/file:yaml|>": 151793,
68
+ "<|/file_content|>": 151762,
69
+ "<|/filename|>": 151807,
70
+ "<|/filepath|>": 151809,
71
+ "<|/final|>": 152131,
72
+ "<|/frame_num|>": 151828,
73
+ "<|/frame|>": 151826,
74
+ "<|/function_args|>": 151850,
75
+ "<|/function_def|>": 151858,
76
+ "<|/function_name|>": 151848,
77
+ "<|/gen_image|>": 151840,
78
+ "<|/gen_video|>": 151842,
79
+ "<|/gh_stars|>": 151714,
80
+ "<|/growl|>": 152091,
81
+ "<|/hard_rule|>": 151695,
82
+ "<|/harmony|>": 152112,
83
+ "<|/hum|>": 152046,
84
+ "<|/hypothesis|>": 151918,
85
+ "<|/image|>": 151811,
86
+ "<|/input|>": 152188,
87
+ "<|/instruction|>": 152182,
88
+ "<|/issue_body|>": 151722,
89
+ "<|/issue_title|>": 151720,
90
+ "<|/issue|>": 151718,
91
+ "<|/item|>": 152168,
92
+ "<|/json|>": 152158,
93
+ "<|/jupyter_code|>": 151736,
94
+ "<|/jupyter_error|>": 151742,
95
+ "<|/jupyter_output|>": 151738,
96
+ "<|/jupyter_text|>": 151740,
97
+ "<|/jupyter|>": 151734,
98
+ "<|/keyframe|>": 151819,
99
+ "<|/key|>": 152058,
100
+ "<|/knowledge_date|>": 151987,
101
+ "<|/kv|>": 152174,
102
+ "<|/line|>": 151766,
103
+ "<|/listen|>": 151989,
104
+ "<|/list|>": 152166,
105
+ "<|/long_term_memory|>": 151685,
106
+ "<|/lyrics|>": 152068,
107
+ "<|/melody|>": 152056,
108
+ "<|/memory|>": 151681,
109
+ "<|/note|>": 151912,
110
+ "<|/object|>": 151838,
111
+ "<|/observation|>": 151910,
112
+ "<|/ol|>": 152170,
113
+ "<|/option|>": 151936,
114
+ "<|/output|>": 152190,
115
+ "<|/param_name|>": 151870,
116
+ "<|/param_type|>": 151872,
117
+ "<|/perc|>": 152078,
118
+ "<|/pitch|>": 152050,
119
+ "<|/plan_step|>": 151924,
120
+ "<|/plan|>": 151922,
121
+ "<|/poly|>": 152114,
122
+ "<|/pr_body|>": 151730,
123
+ "<|/pr_title|>": 151728,
124
+ "<|/prompt|>": 151669,
125
+ "<|/pr|>": 151726,
126
+ "<|/quote|>": 151973,
127
+ "<|/rap|>": 152042,
128
+ "<|/read_file|>": 151760,
129
+ "<|/reflection|>": 151916,
130
+ "<|/ref|>": 151971,
131
+ "<|/region|>": 151834,
132
+ "<|/rename_file|>": 151756,
133
+ "<|/replace|>": 151770,
134
+ "<|/reponame|>": 151712,
135
+ "<|/response|>": 151673,
136
+ "<|/retrieved|>": 151979,
137
+ "<|/rewrite|>": 152123,
138
+ "<|/rhythm|>": 152054,
139
+ "<|/row|>": 152135,
140
+ "<|/scene|>": 151822,
141
+ "<|/schema|>": 152143,
142
+ "<|/segment|>": 151824,
143
+ "<|/session|>": 151697,
144
+ "<|/shout|>": 152089,
145
+ "<|/since|>": 152154,
146
+ "<|/sing|>": 152040,
147
+ "<|/source|>": 151969,
148
+ "<|/speaker_ref|>": 151997,
149
+ "<|/speak|>": 151991,
150
+ "<|/spec|>": 152119,
151
+ "<|/step|>": 151914,
152
+ "<|/summary|>": 151687,
153
+ "<|/system|>": 151675,
154
+ "<|/table|>": 152133,
155
+ "<|/task_type|>": 152180,
156
+ "<|/task|>": 152178,
157
+ "<|/tbody|>": 152141,
158
+ "<|/tempo|>": 152052,
159
+ "<|/text|>": 151671,
160
+ "<|/thead|>": 152139,
161
+ "<|/think|>": 151908,
162
+ "<|/time_range|>": 151817,
163
+ "<|/timestamp|>": 151815,
164
+ "<|/tool_calls|>": 151879,
165
+ "<|/tool_call|>": 151844,
166
+ "<|/tool_def|>": 151862,
167
+ "<|/tool_desc|>": 151866,
168
+ "<|/tool_error|>": 151876,
169
+ "<|/tool_id|>": 151881,
170
+ "<|/tool_name|>": 151864,
171
+ "<|/tool_params|>": 151868,
172
+ "<|/tool_result|>": 151846,
173
+ "<|/tools|>": 151856,
174
+ "<|/type|>": 152147,
175
+ "<|/ul|>": 152172,
176
+ "<|/uncertainty_score|>": 151948,
177
+ "<|/uncertain|>": 151952,
178
+ "<|/user_int|>": 152004,
179
+ "<|/user_pref|>": 151693,
180
+ "<|/user_profile|>": 151691,
181
+ "<|/user|>": 151677,
182
+ "<|/valence|>": 152022,
183
+ "<|/value|>": 152176,
184
+ "<|/verify|>": 151959,
185
+ "<|/verse|>": 152070,
186
+ "<|/version|>": 152151,
187
+ "<|/video|>": 151813,
188
+ "<|/whisper|>": 152087,
189
+ "<|/whistle|>": 152048,
190
+ "<|/working_memory|>": 151683,
191
+ "<|/xml|>": 152160,
192
+ "<|/yaml|>": 152162,
193
+ "<|action|>": 151829,
194
+ "<|add_file|>": 151751,
195
+ "<|adjust|>": 152016,
196
+ "<|adlib|>": 152109,
197
+ "<|agree|>": 152011,
198
+ "<|aha|>": 152102,
199
+ "<|ahem|>": 152100,
200
+ "<|alternatively|>": 151942,
201
+ "<|analysis|>": 151929,
202
+ "<|angry|>": 152027,
203
+ "<|approximate|>": 151957,
204
+ "<|arg_name|>": 151851,
205
+ "<|arg_value|>": 151853,
206
+ "<|arousal|>": 152019,
207
+ "<|assistant|>": 151678,
208
+ "<|attribution|>": 151974,
209
+ "<|audio_prompt|>": 151994,
210
+ "<|audio|>": 151992,
211
+ "<|available_tools|>": 151859,
212
+ "<|backchannel|>": 152009,
213
+ "<|backoff|>": 152002,
214
+ "<|bbox|>": 151835,
215
+ "<|beatbox|>": 152075,
216
+ "<|because|>": 151939,
217
+ "<|beyond_knowledge|>": 151984,
218
+ "<|bored|>": 152034,
219
+ "<|bos|>": 151665,
220
+ "<|box_end|>": 151649,
221
+ "<|box_start|>": 151648,
222
+ "<|branch|>": 151715,
223
+ "<|breakdown|>": 151931,
224
+ "<|breath_heavy|>": 152096,
225
+ "<|breath_in|>": 152094,
226
+ "<|breath_out|>": 152095,
227
+ "<|bridge|>": 152073,
228
+ "<|calm|>": 152037,
229
+ "<|cell|>": 152136,
230
+ "<|certainty_score|>": 151949,
231
+ "<|changelog|>": 152155,
232
+ "<|chant|>": 152043,
233
+ "<|checkpoint|>": 152125,
234
+ "<|chorus|>": 152071,
235
+ "<|chosen|>": 151937,
236
+ "<|cite|>": 151966,
237
+ "<|clarify|>": 151965,
238
+ "<|click|>": 152084,
239
+ "<|code|>": 151882,
240
+ "<|commit_after|>": 151702,
241
+ "<|commit_before|>": 151700,
242
+ "<|commit_msg|>": 151704,
243
+ "<|conclusion|>": 151919,
244
+ "<|condensed|>": 151688,
245
+ "<|conf_tok|>": 152126,
246
+ "<|confidence:high|>": 151943,
247
+ "<|confidence:low|>": 151945,
248
+ "<|confidence:medium|>": 151944,
249
+ "<|confidence:uncertain|>": 151946,
250
+ "<|confused|>": 152010,
251
+ "<|constraint|>": 152183,
252
+ "<|context|>": 151976,
253
+ "<|continue|>": 151999,
254
+ "<|contrast_emo|>": 152036,
255
+ "<|cont|>": 152197,
256
+ "<|conv_history|>": 151698,
257
+ "<|correction|>": 151962,
258
+ "<|cough|>": 152005,
259
+ "<|crash|>": 152082,
260
+ "<|critique|>": 151925,
261
+ "<|csv|>": 152163,
262
+ "<|decision|>": 151933,
263
+ "<|delete_file|>": 151753,
264
+ "<|deprecated|>": 152152,
265
+ "<|diff_add|>": 151708,
266
+ "<|diff_ctx|>": 151710,
267
+ "<|diff_del|>": 151709,
268
+ "<|diff|>": 151706,
269
+ "<|disagree|>": 152012,
270
+ "<|disgusted|>": 152030,
271
+ "<|doc|>": 151781,
272
+ "<|dominance|>": 152023,
273
+ "<|draft|>": 152128,
274
+ "<|edit_file|>": 151757,
275
+ "<|edit_range|>": 151763,
276
+ "<|emotion|>": 152017,
277
+ "<|empty_output|>": 151743,
278
+ "<|endoftext|>": 151643,
279
+ "<|energetic|>": 152038,
280
+ "<|eod|>": 151783,
281
+ "<|eos|>": 151666,
282
+ "<|eot|>": 151998,
283
+ "<|error_found|>": 151927,
284
+ "<|event|>": 151831,
285
+ "<|example|>": 152185,
286
+ "<|excited|>": 152032,
287
+ "<|exec_error|>": 151748,
288
+ "<|exec_result|>": 151746,
289
+ "<|exec_timeout|>": 151750,
290
+ "<|exec|>": 151744,
291
+ "<|expected|>": 152191,
292
+ "<|fact_check|>": 151960,
293
+ "<|falsetto|>": 152092,
294
+ "<|fearful|>": 152028,
295
+ "<|field|>": 152144,
296
+ "<|file:css|>": 151796,
297
+ "<|file:csv|>": 151798,
298
+ "<|file:html|>": 151794,
299
+ "<|file:ini|>": 151802,
300
+ "<|file:json|>": 151788,
301
+ "<|file:log|>": 151804,
302
+ "<|file:md|>": 151786,
303
+ "<|file:toml|>": 151800,
304
+ "<|file:txt|>": 151784,
305
+ "<|file:xml|>": 151790,
306
+ "<|file:yaml|>": 151792,
307
+ "<|file_content|>": 151761,
308
+ "<|file_sep|>": 151664,
309
+ "<|filename|>": 151806,
310
+ "<|filepath|>": 151808,
311
+ "<|fill|>": 152083,
312
+ "<|fim_middle|>": 151660,
313
+ "<|fim_pad|>": 151662,
314
+ "<|fim_prefix|>": 151659,
315
+ "<|fim_suffix|>": 151661,
316
+ "<|final|>": 152130,
317
+ "<|frame_num|>": 151827,
318
+ "<|frame|>": 151825,
319
+ "<|frustrated|>": 152033,
320
+ "<|function_args|>": 151849,
321
+ "<|function_def|>": 151857,
322
+ "<|function_name|>": 151847,
323
+ "<|gasp|>": 152098,
324
+ "<|gen_image|>": 151839,
325
+ "<|gen_video|>": 151841,
326
+ "<|gh_stars|>": 151713,
327
+ "<|gliss|>": 152117,
328
+ "<|grounded|>": 151980,
329
+ "<|growl|>": 152090,
330
+ "<|happy|>": 152025,
331
+ "<|hard_rule|>": 151694,
332
+ "<|harmony|>": 152111,
333
+ "<|hesitation|>": 152008,
334
+ "<|hihat|>": 152081,
335
+ "<|hmm|>": 152101,
336
+ "<|however|>": 151941,
337
+ "<|hum|>": 152045,
338
+ "<|hypothesis|>": 151917,
339
+ "<|im_end|>": 151645,
340
+ "<|im_start|>": 151644,
341
+ "<|image_pad|>": 151655,
342
+ "<|image|>": 151810,
343
+ "<|input|>": 152187,
344
+ "<|insert_after|>": 151768,
345
+ "<|insert_before|>": 151767,
346
+ "<|instruction|>": 152181,
347
+ "<|interrupt|>": 152001,
348
+ "<|issue_body|>": 151721,
349
+ "<|issue_closed|>": 151723,
350
+ "<|issue_open|>": 151724,
351
+ "<|issue_title|>": 151719,
352
+ "<|issue|>": 151717,
353
+ "<|item|>": 152167,
354
+ "<|json|>": 152157,
355
+ "<|jupyter_code|>": 151735,
356
+ "<|jupyter_error|>": 151741,
357
+ "<|jupyter_output|>": 151737,
358
+ "<|jupyter_text|>": 151739,
359
+ "<|jupyter|>": 151733,
360
+ "<|keyframe|>": 151818,
361
+ "<|key|>": 152057,
362
+ "<|kick|>": 152079,
363
+ "<|knowledge_cutoff|>": 151983,
364
+ "<|knowledge_date|>": 151986,
365
+ "<|kv|>": 152173,
366
+ "<|lang:bash|>": 151899,
367
+ "<|lang:cpp|>": 151888,
368
+ "<|lang:csharp|>": 151890,
369
+ "<|lang:c|>": 151889,
370
+ "<|lang:go|>": 151891,
371
+ "<|lang:haskell|>": 151905,
372
+ "<|lang:javascript|>": 151885,
373
+ "<|lang:java|>": 151887,
374
+ "<|lang:kotlin|>": 151896,
375
+ "<|lang:lua|>": 151903,
376
+ "<|lang:matlab|>": 151902,
377
+ "<|lang:other|>": 151906,
378
+ "<|lang:perl|>": 151904,
379
+ "<|lang:php|>": 151894,
380
+ "<|lang:python|>": 151884,
381
+ "<|lang:ruby|>": 151893,
382
+ "<|lang:rust|>": 151892,
383
+ "<|lang:r|>": 151901,
384
+ "<|lang:scala|>": 151897,
385
+ "<|lang:shell|>": 151898,
386
+ "<|lang:sql|>": 151900,
387
+ "<|lang:swift|>": 151895,
388
+ "<|lang:typescript|>": 151886,
389
+ "<|laugh|>": 152006,
390
+ "<|line|>": 151765,
391
+ "<|listen|>": 151988,
392
+ "<|list|>": 152165,
393
+ "<|long_term_memory|>": 151684,
394
+ "<|lyrics|>": 152067,
395
+ "<|mask|>": 152195,
396
+ "<|match_emo|>": 152035,
397
+ "<|may_outdated|>": 151955,
398
+ "<|melody|>": 152055,
399
+ "<|memory|>": 151680,
400
+ "<|need_verify|>": 151954,
401
+ "<|neutral|>": 152031,
402
+ "<|nl|>": 152194,
403
+ "<|no_error|>": 151928,
404
+ "<|note|>": 151911,
405
+ "<|object_ref_end|>": 151647,
406
+ "<|object_ref_start|>": 151646,
407
+ "<|object|>": 151837,
408
+ "<|observation|>": 151909,
409
+ "<|ol|>": 152169,
410
+ "<|ooh|>": 152103,
411
+ "<|optional|>": 152149,
412
+ "<|option|>": 151935,
413
+ "<|output|>": 152189,
414
+ "<|pad|>": 151667,
415
+ "<|param_name|>": 151869,
416
+ "<|param_optional|>": 151874,
417
+ "<|param_required|>": 151873,
418
+ "<|param_type|>": 151871,
419
+ "<|partially_grounded|>": 151982,
420
+ "<|pause|>": 152013,
421
+ "<|perc|>": 152077,
422
+ "<|phew|>": 152106,
423
+ "<|pitch|>": 152049,
424
+ "<|plan_step|>": 151923,
425
+ "<|plan|>": 151921,
426
+ "<|poly|>": 152113,
427
+ "<|pop|>": 152085,
428
+ "<|pr_body|>": 151729,
429
+ "<|pr_closed|>": 151732,
430
+ "<|pr_merged|>": 151731,
431
+ "<|pr_title|>": 151727,
432
+ "<|prompt|>": 151668,
433
+ "<|pr|>": 151725,
434
+ "<|quad_end|>": 151651,
435
+ "<|quad_start|>": 151650,
436
+ "<|quote|>": 151972,
437
+ "<|rap|>": 152041,
438
+ "<|read_file|>": 151759,
439
+ "<|redacted|>": 152199,
440
+ "<|reflection|>": 151915,
441
+ "<|ref|>": 151970,
442
+ "<|region|>": 151833,
443
+ "<|rejected|>": 151938,
444
+ "<|rename_file|>": 151755,
445
+ "<|replace|>": 151769,
446
+ "<|repo_name|>": 151663,
447
+ "<|reponame|>": 151711,
448
+ "<|required|>": 152148,
449
+ "<|response|>": 151672,
450
+ "<|resume|>": 152014,
451
+ "<|retract|>": 151964,
452
+ "<|retrieved|>": 151978,
453
+ "<|rewind|>": 152015,
454
+ "<|rewrite|>": 152122,
455
+ "<|rhythm|>": 152053,
456
+ "<|rollback|>": 152124,
457
+ "<|row|>": 152134,
458
+ "<|sad|>": 152026,
459
+ "<|scene_change|>": 151820,
460
+ "<|scene|>": 151821,
461
+ "<|schema|>": 152142,
462
+ "<|segment|>": 151823,
463
+ "<|self_correct|>": 151961,
464
+ "<|sep|>": 152193,
465
+ "<|session|>": 151696,
466
+ "<|shh|>": 152108,
467
+ "<|shout|>": 152088,
468
+ "<|sigh_x|>": 152097,
469
+ "<|sigh|>": 152007,
470
+ "<|since|>": 152153,
471
+ "<|sing|>": 152039,
472
+ "<|snare|>": 152080,
473
+ "<|source|>": 151968,
474
+ "<|speaker_ref|>": 151996,
475
+ "<|speak|>": 151990,
476
+ "<|spec_no|>": 152121,
477
+ "<|spec_ok|>": 152120,
478
+ "<|speculative|>": 151956,
479
+ "<|spec|>": 152118,
480
+ "<|step|>": 151913,
481
+ "<|style:classical|>": 152062,
482
+ "<|style:country|>": 152065,
483
+ "<|style:hiphop|>": 152063,
484
+ "<|style:jazz|>": 152061,
485
+ "<|style:pop|>": 152059,
486
+ "<|style:rnb|>": 152064,
487
+ "<|style:rock|>": 152060,
488
+ "<|style:soul|>": 152066,
489
+ "<|summary|>": 151686,
490
+ "<|surprised|>": 152029,
491
+ "<|system|>": 151674,
492
+ "<|table|>": 152132,
493
+ "<|task_type|>": 152179,
494
+ "<|task|>": 152177,
495
+ "<|tbody|>": 152140,
496
+ "<|tempo|>": 152051,
497
+ "<|text|>": 151670,
498
+ "<|thead|>": 152138,
499
+ "<|therefore|>": 151940,
500
+ "<|think|>": 151907,
501
+ "<|time_range|>": 151816,
502
+ "<|timestamp|>": 151814,
503
+ "<|tool_calls|>": 151878,
504
+ "<|tool_call|>": 151843,
505
+ "<|tool_def|>": 151861,
506
+ "<|tool_desc|>": 151865,
507
+ "<|tool_error|>": 151875,
508
+ "<|tool_id|>": 151880,
509
+ "<|tool_name|>": 151863,
510
+ "<|tool_params|>": 151867,
511
+ "<|tool_result|>": 151845,
512
+ "<|tool_success|>": 151877,
513
+ "<|tools|>": 151855,
514
+ "<|tremolo|>": 152116,
515
+ "<|truncated|>": 152198,
516
+ "<|tsk|>": 152107,
517
+ "<|type|>": 152146,
518
+ "<|ugh|>": 152105,
519
+ "<|ul|>": 152171,
520
+ "<|unc_tok|>": 152127,
521
+ "<|uncertainty_score|>": 151947,
522
+ "<|uncertain|>": 151951,
523
+ "<|ungrounded|>": 151981,
524
+ "<|unknown|>": 151953,
525
+ "<|user_int|>": 152003,
526
+ "<|user_pref|>": 151692,
527
+ "<|user_profile|>": 151690,
528
+ "<|user|>": 151676,
529
+ "<|valence|>": 152021,
530
+ "<|value|>": 152175,
531
+ "<|verify|>": 151958,
532
+ "<|verse|>": 152069,
533
+ "<|version|>": 152150,
534
+ "<|vibrato|>": 152115,
535
+ "<|video_pad|>": 151656,
536
+ "<|video|>": 151812,
537
+ "<|vision_end|>": 151653,
538
+ "<|vision_pad|>": 151654,
539
+ "<|vision_start|>": 151652,
540
+ "<|whisper|>": 152086,
541
+ "<|whistle|>": 152047,
542
+ "<|within_knowledge|>": 151985,
543
+ "<|working_memory|>": 151682,
544
+ "<|wow|>": 152104,
545
+ "<|xml|>": 152159,
546
+ "<|yaml|>": 152161,
547
+ "<|yawn|>": 152099,
548
+ "<|yield|>": 152000,
549
+ "[d~[": 151773,
550
+ "[e~[": 151771,
551
+ "[m~[": 151779,
552
+ "[p~[": 151775,
553
+ "]~!b[": 151778,
554
+ "]~b]": 151777,
555
+ "]~d]": 151774,
556
+ "]~e]": 151772,
557
+ "]~m]": 151780,
558
+ "]~p]": 151776
559
+ }
audio_decoder.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a2b0558451b5a8ee083e17a15deaa6fbd61081954477e7dfa15506d2a602213d
3
- size 2788209752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9f369795e1f9e71b138a0dd3705d8549661085d292fdbf729982ba0e4f2b6ab
3
+ size 1458415836
audio_encoder.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:47edc19a3e4225f602556af592208e410f2b0c0ee0412cffe3e1650ca8cf0d89
3
- size 689538704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1170b76158b117e913232d6a55dd51638c9e72f91bec4e85f1ce866cfe3b7744
3
+ size 466150140
audio_projector.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:43003dc667e1777c275530155bf980a62d08b878062a9e63b7e797fc5debd66f
3
- size 4198552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df1d4100644c839f5d6f31ff19fc787fa0cb2416b3fdec70955df4331ed7902a
3
+ size 2099352
cross_attention.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:142eff322380538b068e0c78114e797473b12d72f3bfe769bd353b19b0bb4204
3
- size 348361664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00ccf22a5f8b57898225721289813d8ed505792fb72da5cee876361dce723121
3
+ size 174191400
generator.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3193c75a5585dde156ec1cce53f924d1c6c9db84964b3e3f7b2561e02f74cdda
3
- size 1258822080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b89dbdfd553807dafa1575d850aa47b60edbc4cb851bf8fa2e414e658c3e169
3
+ size 629440508
llm.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b40cf5aaf30bd17af85dab0fab917187c07e230c766dd47b634b0c229c6a11a
3
- size 3012498960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c66c683c33908f29d47b1a83b7a463d695da78c4e745e57f26ffc2633b8dd164
3
+ size 1506831304
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
modality_markers.safetensors CHANGED
Binary files a/modality_markers.safetensors and b/modality_markers.safetensors differ
 
projector.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7d9e0fded469d0089346bbbf366ead991d0bdfcef50dd20b9b59de10016bbeb
3
- size 105757984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2090fa0134d9992f2aeb1e1a4267c262f234d7347012ff344b40facf54bb9180
3
+ size 52880664
special_tokens.json CHANGED
@@ -337,6 +337,140 @@
337
  "audio_prompt_end": "<|/audio_prompt|>",
338
  "speaker_ref_start": "<|speaker_ref|>",
339
  "speaker_ref_end": "<|/speaker_ref|>",
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
340
  "table_start": "<|table|>",
341
  "table_end": "<|/table|>",
342
  "table_row_start": "<|row|>",
 
337
  "audio_prompt_end": "<|/audio_prompt|>",
338
  "speaker_ref_start": "<|speaker_ref|>",
339
  "speaker_ref_end": "<|/speaker_ref|>",
340
+ "eot_predict": "<|eot|>",
341
+ "eot_continue": "<|continue|>",
342
+ "eot_yield": "<|yield|>",
343
+ "eot_interrupt": "<|interrupt|>",
344
+ "eot_backoff": "<|backoff|>",
345
+ "user_interrupt_start": "<|user_int|>",
346
+ "user_interrupt_end": "<|/user_int|>",
347
+ "user_cough": "<|cough|>",
348
+ "user_laugh": "<|laugh|>",
349
+ "user_sigh": "<|sigh|>",
350
+ "user_hesitation": "<|hesitation|>",
351
+ "user_backchannel": "<|backchannel|>",
352
+ "user_confusion": "<|confused|>",
353
+ "user_agreement": "<|agree|>",
354
+ "user_disagreement": "<|disagree|>",
355
+ "response_pause": "<|pause|>",
356
+ "response_resume": "<|resume|>",
357
+ "response_rewind": "<|rewind|>",
358
+ "response_adjust": "<|adjust|>",
359
+ "emotion_start": "<|emotion|>",
360
+ "emotion_end": "<|/emotion|>",
361
+ "arousal_level": "<|arousal|>",
362
+ "arousal_end": "<|/arousal|>",
363
+ "valence_level": "<|valence|>",
364
+ "valence_end": "<|/valence|>",
365
+ "dominance_level": "<|dominance|>",
366
+ "dominance_end": "<|/dominance|>",
367
+ "emotion_happy": "<|happy|>",
368
+ "emotion_sad": "<|sad|>",
369
+ "emotion_angry": "<|angry|>",
370
+ "emotion_fearful": "<|fearful|>",
371
+ "emotion_surprised": "<|surprised|>",
372
+ "emotion_disgusted": "<|disgusted|>",
373
+ "emotion_neutral": "<|neutral|>",
374
+ "emotion_excited": "<|excited|>",
375
+ "emotion_frustrated": "<|frustrated|>",
376
+ "emotion_bored": "<|bored|>",
377
+ "match_emotion": "<|match_emo|>",
378
+ "contrast_emotion": "<|contrast_emo|>",
379
+ "calm_response": "<|calm|>",
380
+ "energetic_response": "<|energetic|>",
381
+ "sing_start": "<|sing|>",
382
+ "sing_end": "<|/sing|>",
383
+ "rap_start": "<|rap|>",
384
+ "rap_end": "<|/rap|>",
385
+ "chant_start": "<|chant|>",
386
+ "chant_end": "<|/chant|>",
387
+ "hum_start": "<|hum|>",
388
+ "hum_end": "<|/hum|>",
389
+ "whistle_start": "<|whistle|>",
390
+ "whistle_end": "<|/whistle|>",
391
+ "pitch_start": "<|pitch|>",
392
+ "pitch_end": "<|/pitch|>",
393
+ "tempo_start": "<|tempo|>",
394
+ "tempo_end": "<|/tempo|>",
395
+ "rhythm_start": "<|rhythm|>",
396
+ "rhythm_end": "<|/rhythm|>",
397
+ "melody_start": "<|melody|>",
398
+ "melody_end": "<|/melody|>",
399
+ "key_signature": "<|key|>",
400
+ "key_signature_end": "<|/key|>",
401
+ "style_pop": "<|style:pop|>",
402
+ "style_rock": "<|style:rock|>",
403
+ "style_jazz": "<|style:jazz|>",
404
+ "style_classical": "<|style:classical|>",
405
+ "style_hiphop": "<|style:hiphop|>",
406
+ "style_rnb": "<|style:rnb|>",
407
+ "style_country": "<|style:country|>",
408
+ "style_soul": "<|style:soul|>",
409
+ "lyrics_start": "<|lyrics|>",
410
+ "lyrics_end": "<|/lyrics|>",
411
+ "verse_start": "<|verse|>",
412
+ "verse_end": "<|/verse|>",
413
+ "chorus_start": "<|chorus|>",
414
+ "chorus_end": "<|/chorus|>",
415
+ "bridge_start": "<|bridge|>",
416
+ "bridge_end": "<|/bridge|>",
417
+ "beatbox_start": "<|beatbox|>",
418
+ "beatbox_end": "<|/beatbox|>",
419
+ "percussion_start": "<|perc|>",
420
+ "percussion_end": "<|/perc|>",
421
+ "drum_kick": "<|kick|>",
422
+ "drum_snare": "<|snare|>",
423
+ "drum_hihat": "<|hihat|>",
424
+ "drum_crash": "<|crash|>",
425
+ "drum_fill": "<|fill|>",
426
+ "click": "<|click|>",
427
+ "pop": "<|pop|>",
428
+ "whisper_start": "<|whisper|>",
429
+ "whisper_end": "<|/whisper|>",
430
+ "shout_start": "<|shout|>",
431
+ "shout_end": "<|/shout|>",
432
+ "growl_start": "<|growl|>",
433
+ "growl_end": "<|/growl|>",
434
+ "falsetto_start": "<|falsetto|>",
435
+ "falsetto_end": "<|/falsetto|>",
436
+ "breath_in": "<|breath_in|>",
437
+ "breath_out": "<|breath_out|>",
438
+ "breath_heavy": "<|breath_heavy|>",
439
+ "sigh_express": "<|sigh_x|>",
440
+ "gasp": "<|gasp|>",
441
+ "yawn": "<|yawn|>",
442
+ "clear_throat": "<|ahem|>",
443
+ "hmm": "<|hmm|>",
444
+ "aha": "<|aha|>",
445
+ "ooh": "<|ooh|>",
446
+ "wow": "<|wow|>",
447
+ "ugh": "<|ugh|>",
448
+ "phew": "<|phew|>",
449
+ "tsk": "<|tsk|>",
450
+ "shh": "<|shh|>",
451
+ "adlib_start": "<|adlib|>",
452
+ "adlib_end": "<|/adlib|>",
453
+ "harmony_start": "<|harmony|>",
454
+ "harmony_end": "<|/harmony|>",
455
+ "polyphonic_start": "<|poly|>",
456
+ "polyphonic_end": "<|/poly|>",
457
+ "vibrato": "<|vibrato|>",
458
+ "tremolo": "<|tremolo|>",
459
+ "glissando": "<|gliss|>",
460
+ "speculate_start": "<|spec|>",
461
+ "speculate_end": "<|/spec|>",
462
+ "speculate_accept": "<|spec_ok|>",
463
+ "speculate_reject": "<|spec_no|>",
464
+ "rewrite_start": "<|rewrite|>",
465
+ "rewrite_end": "<|/rewrite|>",
466
+ "rollback": "<|rollback|>",
467
+ "checkpoint": "<|checkpoint|>",
468
+ "token_confident": "<|conf_tok|>",
469
+ "token_uncertain": "<|unc_tok|>",
470
+ "draft_start": "<|draft|>",
471
+ "draft_end": "<|/draft|>",
472
+ "final_start": "<|final|>",
473
+ "final_end": "<|/final|>",
474
  "table_start": "<|table|>",
475
  "table_end": "<|/table|>",
476
  "table_row_start": "<|row|>",
special_tokens_map.json ADDED
@@ -0,0 +1,3801 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "<|bos|>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "<|eos|>",
12
+ "lstrip": false,
13
+ "normalized": false,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "<|pad|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "<|prompt|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ },
31
+ {
32
+ "content": "<|/prompt|>",
33
+ "lstrip": false,
34
+ "normalized": false,
35
+ "rstrip": false,
36
+ "single_word": false
37
+ },
38
+ {
39
+ "content": "<|text|>",
40
+ "lstrip": false,
41
+ "normalized": false,
42
+ "rstrip": false,
43
+ "single_word": false
44
+ },
45
+ {
46
+ "content": "<|/text|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false
51
+ },
52
+ {
53
+ "content": "<|response|>",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false
58
+ },
59
+ {
60
+ "content": "<|/response|>",
61
+ "lstrip": false,
62
+ "normalized": false,
63
+ "rstrip": false,
64
+ "single_word": false
65
+ },
66
+ {
67
+ "content": "<|system|>",
68
+ "lstrip": false,
69
+ "normalized": false,
70
+ "rstrip": false,
71
+ "single_word": false
72
+ },
73
+ {
74
+ "content": "<|/system|>",
75
+ "lstrip": false,
76
+ "normalized": false,
77
+ "rstrip": false,
78
+ "single_word": false
79
+ },
80
+ {
81
+ "content": "<|user|>",
82
+ "lstrip": false,
83
+ "normalized": false,
84
+ "rstrip": false,
85
+ "single_word": false
86
+ },
87
+ {
88
+ "content": "<|/user|>",
89
+ "lstrip": false,
90
+ "normalized": false,
91
+ "rstrip": false,
92
+ "single_word": false
93
+ },
94
+ {
95
+ "content": "<|assistant|>",
96
+ "lstrip": false,
97
+ "normalized": false,
98
+ "rstrip": false,
99
+ "single_word": false
100
+ },
101
+ {
102
+ "content": "<|/assistant|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false
107
+ },
108
+ {
109
+ "content": "<|memory|>",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false
114
+ },
115
+ {
116
+ "content": "<|/memory|>",
117
+ "lstrip": false,
118
+ "normalized": false,
119
+ "rstrip": false,
120
+ "single_word": false
121
+ },
122
+ {
123
+ "content": "<|working_memory|>",
124
+ "lstrip": false,
125
+ "normalized": false,
126
+ "rstrip": false,
127
+ "single_word": false
128
+ },
129
+ {
130
+ "content": "<|/working_memory|>",
131
+ "lstrip": false,
132
+ "normalized": false,
133
+ "rstrip": false,
134
+ "single_word": false
135
+ },
136
+ {
137
+ "content": "<|long_term_memory|>",
138
+ "lstrip": false,
139
+ "normalized": false,
140
+ "rstrip": false,
141
+ "single_word": false
142
+ },
143
+ {
144
+ "content": "<|/long_term_memory|>",
145
+ "lstrip": false,
146
+ "normalized": false,
147
+ "rstrip": false,
148
+ "single_word": false
149
+ },
150
+ {
151
+ "content": "<|summary|>",
152
+ "lstrip": false,
153
+ "normalized": false,
154
+ "rstrip": false,
155
+ "single_word": false
156
+ },
157
+ {
158
+ "content": "<|/summary|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false
163
+ },
164
+ {
165
+ "content": "<|condensed|>",
166
+ "lstrip": false,
167
+ "normalized": false,
168
+ "rstrip": false,
169
+ "single_word": false
170
+ },
171
+ {
172
+ "content": "<|/condensed|>",
173
+ "lstrip": false,
174
+ "normalized": false,
175
+ "rstrip": false,
176
+ "single_word": false
177
+ },
178
+ {
179
+ "content": "<|user_profile|>",
180
+ "lstrip": false,
181
+ "normalized": false,
182
+ "rstrip": false,
183
+ "single_word": false
184
+ },
185
+ {
186
+ "content": "<|/user_profile|>",
187
+ "lstrip": false,
188
+ "normalized": false,
189
+ "rstrip": false,
190
+ "single_word": false
191
+ },
192
+ {
193
+ "content": "<|user_pref|>",
194
+ "lstrip": false,
195
+ "normalized": false,
196
+ "rstrip": false,
197
+ "single_word": false
198
+ },
199
+ {
200
+ "content": "<|/user_pref|>",
201
+ "lstrip": false,
202
+ "normalized": false,
203
+ "rstrip": false,
204
+ "single_word": false
205
+ },
206
+ {
207
+ "content": "<|hard_rule|>",
208
+ "lstrip": false,
209
+ "normalized": false,
210
+ "rstrip": false,
211
+ "single_word": false
212
+ },
213
+ {
214
+ "content": "<|/hard_rule|>",
215
+ "lstrip": false,
216
+ "normalized": false,
217
+ "rstrip": false,
218
+ "single_word": false
219
+ },
220
+ {
221
+ "content": "<|session|>",
222
+ "lstrip": false,
223
+ "normalized": false,
224
+ "rstrip": false,
225
+ "single_word": false
226
+ },
227
+ {
228
+ "content": "<|/session|>",
229
+ "lstrip": false,
230
+ "normalized": false,
231
+ "rstrip": false,
232
+ "single_word": false
233
+ },
234
+ {
235
+ "content": "<|conv_history|>",
236
+ "lstrip": false,
237
+ "normalized": false,
238
+ "rstrip": false,
239
+ "single_word": false
240
+ },
241
+ {
242
+ "content": "<|/conv_history|>",
243
+ "lstrip": false,
244
+ "normalized": false,
245
+ "rstrip": false,
246
+ "single_word": false
247
+ },
248
+ {
249
+ "content": "<|fim_prefix|>",
250
+ "lstrip": false,
251
+ "normalized": false,
252
+ "rstrip": false,
253
+ "single_word": false
254
+ },
255
+ {
256
+ "content": "<|fim_middle|>",
257
+ "lstrip": false,
258
+ "normalized": false,
259
+ "rstrip": false,
260
+ "single_word": false
261
+ },
262
+ {
263
+ "content": "<|fim_suffix|>",
264
+ "lstrip": false,
265
+ "normalized": false,
266
+ "rstrip": false,
267
+ "single_word": false
268
+ },
269
+ {
270
+ "content": "<|fim_pad|>",
271
+ "lstrip": false,
272
+ "normalized": false,
273
+ "rstrip": false,
274
+ "single_word": false
275
+ },
276
+ {
277
+ "content": "<|commit_before|>",
278
+ "lstrip": false,
279
+ "normalized": false,
280
+ "rstrip": false,
281
+ "single_word": false
282
+ },
283
+ {
284
+ "content": "<|/commit_before|>",
285
+ "lstrip": false,
286
+ "normalized": false,
287
+ "rstrip": false,
288
+ "single_word": false
289
+ },
290
+ {
291
+ "content": "<|commit_after|>",
292
+ "lstrip": false,
293
+ "normalized": false,
294
+ "rstrip": false,
295
+ "single_word": false
296
+ },
297
+ {
298
+ "content": "<|/commit_after|>",
299
+ "lstrip": false,
300
+ "normalized": false,
301
+ "rstrip": false,
302
+ "single_word": false
303
+ },
304
+ {
305
+ "content": "<|commit_msg|>",
306
+ "lstrip": false,
307
+ "normalized": false,
308
+ "rstrip": false,
309
+ "single_word": false
310
+ },
311
+ {
312
+ "content": "<|/commit_msg|>",
313
+ "lstrip": false,
314
+ "normalized": false,
315
+ "rstrip": false,
316
+ "single_word": false
317
+ },
318
+ {
319
+ "content": "<|diff|>",
320
+ "lstrip": false,
321
+ "normalized": false,
322
+ "rstrip": false,
323
+ "single_word": false
324
+ },
325
+ {
326
+ "content": "<|/diff|>",
327
+ "lstrip": false,
328
+ "normalized": false,
329
+ "rstrip": false,
330
+ "single_word": false
331
+ },
332
+ {
333
+ "content": "<|diff_add|>",
334
+ "lstrip": false,
335
+ "normalized": false,
336
+ "rstrip": false,
337
+ "single_word": false
338
+ },
339
+ {
340
+ "content": "<|diff_del|>",
341
+ "lstrip": false,
342
+ "normalized": false,
343
+ "rstrip": false,
344
+ "single_word": false
345
+ },
346
+ {
347
+ "content": "<|diff_ctx|>",
348
+ "lstrip": false,
349
+ "normalized": false,
350
+ "rstrip": false,
351
+ "single_word": false
352
+ },
353
+ {
354
+ "content": "<|reponame|>",
355
+ "lstrip": false,
356
+ "normalized": false,
357
+ "rstrip": false,
358
+ "single_word": false
359
+ },
360
+ {
361
+ "content": "<|/reponame|>",
362
+ "lstrip": false,
363
+ "normalized": false,
364
+ "rstrip": false,
365
+ "single_word": false
366
+ },
367
+ {
368
+ "content": "<|gh_stars|>",
369
+ "lstrip": false,
370
+ "normalized": false,
371
+ "rstrip": false,
372
+ "single_word": false
373
+ },
374
+ {
375
+ "content": "<|/gh_stars|>",
376
+ "lstrip": false,
377
+ "normalized": false,
378
+ "rstrip": false,
379
+ "single_word": false
380
+ },
381
+ {
382
+ "content": "<|branch|>",
383
+ "lstrip": false,
384
+ "normalized": false,
385
+ "rstrip": false,
386
+ "single_word": false
387
+ },
388
+ {
389
+ "content": "<|/branch|>",
390
+ "lstrip": false,
391
+ "normalized": false,
392
+ "rstrip": false,
393
+ "single_word": false
394
+ },
395
+ {
396
+ "content": "<|issue|>",
397
+ "lstrip": false,
398
+ "normalized": false,
399
+ "rstrip": false,
400
+ "single_word": false
401
+ },
402
+ {
403
+ "content": "<|/issue|>",
404
+ "lstrip": false,
405
+ "normalized": false,
406
+ "rstrip": false,
407
+ "single_word": false
408
+ },
409
+ {
410
+ "content": "<|issue_title|>",
411
+ "lstrip": false,
412
+ "normalized": false,
413
+ "rstrip": false,
414
+ "single_word": false
415
+ },
416
+ {
417
+ "content": "<|/issue_title|>",
418
+ "lstrip": false,
419
+ "normalized": false,
420
+ "rstrip": false,
421
+ "single_word": false
422
+ },
423
+ {
424
+ "content": "<|issue_body|>",
425
+ "lstrip": false,
426
+ "normalized": false,
427
+ "rstrip": false,
428
+ "single_word": false
429
+ },
430
+ {
431
+ "content": "<|/issue_body|>",
432
+ "lstrip": false,
433
+ "normalized": false,
434
+ "rstrip": false,
435
+ "single_word": false
436
+ },
437
+ {
438
+ "content": "<|issue_closed|>",
439
+ "lstrip": false,
440
+ "normalized": false,
441
+ "rstrip": false,
442
+ "single_word": false
443
+ },
444
+ {
445
+ "content": "<|issue_open|>",
446
+ "lstrip": false,
447
+ "normalized": false,
448
+ "rstrip": false,
449
+ "single_word": false
450
+ },
451
+ {
452
+ "content": "<|pr|>",
453
+ "lstrip": false,
454
+ "normalized": false,
455
+ "rstrip": false,
456
+ "single_word": false
457
+ },
458
+ {
459
+ "content": "<|/pr|>",
460
+ "lstrip": false,
461
+ "normalized": false,
462
+ "rstrip": false,
463
+ "single_word": false
464
+ },
465
+ {
466
+ "content": "<|pr_title|>",
467
+ "lstrip": false,
468
+ "normalized": false,
469
+ "rstrip": false,
470
+ "single_word": false
471
+ },
472
+ {
473
+ "content": "<|/pr_title|>",
474
+ "lstrip": false,
475
+ "normalized": false,
476
+ "rstrip": false,
477
+ "single_word": false
478
+ },
479
+ {
480
+ "content": "<|pr_body|>",
481
+ "lstrip": false,
482
+ "normalized": false,
483
+ "rstrip": false,
484
+ "single_word": false
485
+ },
486
+ {
487
+ "content": "<|/pr_body|>",
488
+ "lstrip": false,
489
+ "normalized": false,
490
+ "rstrip": false,
491
+ "single_word": false
492
+ },
493
+ {
494
+ "content": "<|pr_merged|>",
495
+ "lstrip": false,
496
+ "normalized": false,
497
+ "rstrip": false,
498
+ "single_word": false
499
+ },
500
+ {
501
+ "content": "<|pr_closed|>",
502
+ "lstrip": false,
503
+ "normalized": false,
504
+ "rstrip": false,
505
+ "single_word": false
506
+ },
507
+ {
508
+ "content": "<|jupyter|>",
509
+ "lstrip": false,
510
+ "normalized": false,
511
+ "rstrip": false,
512
+ "single_word": false
513
+ },
514
+ {
515
+ "content": "<|/jupyter|>",
516
+ "lstrip": false,
517
+ "normalized": false,
518
+ "rstrip": false,
519
+ "single_word": false
520
+ },
521
+ {
522
+ "content": "<|jupyter_code|>",
523
+ "lstrip": false,
524
+ "normalized": false,
525
+ "rstrip": false,
526
+ "single_word": false
527
+ },
528
+ {
529
+ "content": "<|/jupyter_code|>",
530
+ "lstrip": false,
531
+ "normalized": false,
532
+ "rstrip": false,
533
+ "single_word": false
534
+ },
535
+ {
536
+ "content": "<|jupyter_output|>",
537
+ "lstrip": false,
538
+ "normalized": false,
539
+ "rstrip": false,
540
+ "single_word": false
541
+ },
542
+ {
543
+ "content": "<|/jupyter_output|>",
544
+ "lstrip": false,
545
+ "normalized": false,
546
+ "rstrip": false,
547
+ "single_word": false
548
+ },
549
+ {
550
+ "content": "<|jupyter_text|>",
551
+ "lstrip": false,
552
+ "normalized": false,
553
+ "rstrip": false,
554
+ "single_word": false
555
+ },
556
+ {
557
+ "content": "<|/jupyter_text|>",
558
+ "lstrip": false,
559
+ "normalized": false,
560
+ "rstrip": false,
561
+ "single_word": false
562
+ },
563
+ {
564
+ "content": "<|jupyter_error|>",
565
+ "lstrip": false,
566
+ "normalized": false,
567
+ "rstrip": false,
568
+ "single_word": false
569
+ },
570
+ {
571
+ "content": "<|/jupyter_error|>",
572
+ "lstrip": false,
573
+ "normalized": false,
574
+ "rstrip": false,
575
+ "single_word": false
576
+ },
577
+ {
578
+ "content": "<|empty_output|>",
579
+ "lstrip": false,
580
+ "normalized": false,
581
+ "rstrip": false,
582
+ "single_word": false
583
+ },
584
+ {
585
+ "content": "<|exec|>",
586
+ "lstrip": false,
587
+ "normalized": false,
588
+ "rstrip": false,
589
+ "single_word": false
590
+ },
591
+ {
592
+ "content": "<|/exec|>",
593
+ "lstrip": false,
594
+ "normalized": false,
595
+ "rstrip": false,
596
+ "single_word": false
597
+ },
598
+ {
599
+ "content": "<|exec_result|>",
600
+ "lstrip": false,
601
+ "normalized": false,
602
+ "rstrip": false,
603
+ "single_word": false
604
+ },
605
+ {
606
+ "content": "<|/exec_result|>",
607
+ "lstrip": false,
608
+ "normalized": false,
609
+ "rstrip": false,
610
+ "single_word": false
611
+ },
612
+ {
613
+ "content": "<|exec_error|>",
614
+ "lstrip": false,
615
+ "normalized": false,
616
+ "rstrip": false,
617
+ "single_word": false
618
+ },
619
+ {
620
+ "content": "<|/exec_error|>",
621
+ "lstrip": false,
622
+ "normalized": false,
623
+ "rstrip": false,
624
+ "single_word": false
625
+ },
626
+ {
627
+ "content": "<|exec_timeout|>",
628
+ "lstrip": false,
629
+ "normalized": false,
630
+ "rstrip": false,
631
+ "single_word": false
632
+ },
633
+ {
634
+ "content": "<|add_file|>",
635
+ "lstrip": false,
636
+ "normalized": false,
637
+ "rstrip": false,
638
+ "single_word": false
639
+ },
640
+ {
641
+ "content": "<|/add_file|>",
642
+ "lstrip": false,
643
+ "normalized": false,
644
+ "rstrip": false,
645
+ "single_word": false
646
+ },
647
+ {
648
+ "content": "<|delete_file|>",
649
+ "lstrip": false,
650
+ "normalized": false,
651
+ "rstrip": false,
652
+ "single_word": false
653
+ },
654
+ {
655
+ "content": "<|/delete_file|>",
656
+ "lstrip": false,
657
+ "normalized": false,
658
+ "rstrip": false,
659
+ "single_word": false
660
+ },
661
+ {
662
+ "content": "<|rename_file|>",
663
+ "lstrip": false,
664
+ "normalized": false,
665
+ "rstrip": false,
666
+ "single_word": false
667
+ },
668
+ {
669
+ "content": "<|/rename_file|>",
670
+ "lstrip": false,
671
+ "normalized": false,
672
+ "rstrip": false,
673
+ "single_word": false
674
+ },
675
+ {
676
+ "content": "<|edit_file|>",
677
+ "lstrip": false,
678
+ "normalized": false,
679
+ "rstrip": false,
680
+ "single_word": false
681
+ },
682
+ {
683
+ "content": "<|/edit_file|>",
684
+ "lstrip": false,
685
+ "normalized": false,
686
+ "rstrip": false,
687
+ "single_word": false
688
+ },
689
+ {
690
+ "content": "<|read_file|>",
691
+ "lstrip": false,
692
+ "normalized": false,
693
+ "rstrip": false,
694
+ "single_word": false
695
+ },
696
+ {
697
+ "content": "<|/read_file|>",
698
+ "lstrip": false,
699
+ "normalized": false,
700
+ "rstrip": false,
701
+ "single_word": false
702
+ },
703
+ {
704
+ "content": "<|file_sep|>",
705
+ "lstrip": false,
706
+ "normalized": false,
707
+ "rstrip": false,
708
+ "single_word": false
709
+ },
710
+ {
711
+ "content": "<|file_content|>",
712
+ "lstrip": false,
713
+ "normalized": false,
714
+ "rstrip": false,
715
+ "single_word": false
716
+ },
717
+ {
718
+ "content": "<|/file_content|>",
719
+ "lstrip": false,
720
+ "normalized": false,
721
+ "rstrip": false,
722
+ "single_word": false
723
+ },
724
+ {
725
+ "content": "<|edit_range|>",
726
+ "lstrip": false,
727
+ "normalized": false,
728
+ "rstrip": false,
729
+ "single_word": false
730
+ },
731
+ {
732
+ "content": "<|/edit_range|>",
733
+ "lstrip": false,
734
+ "normalized": false,
735
+ "rstrip": false,
736
+ "single_word": false
737
+ },
738
+ {
739
+ "content": "<|line|>",
740
+ "lstrip": false,
741
+ "normalized": false,
742
+ "rstrip": false,
743
+ "single_word": false
744
+ },
745
+ {
746
+ "content": "<|/line|>",
747
+ "lstrip": false,
748
+ "normalized": false,
749
+ "rstrip": false,
750
+ "single_word": false
751
+ },
752
+ {
753
+ "content": "<|insert_before|>",
754
+ "lstrip": false,
755
+ "normalized": false,
756
+ "rstrip": false,
757
+ "single_word": false
758
+ },
759
+ {
760
+ "content": "<|insert_after|>",
761
+ "lstrip": false,
762
+ "normalized": false,
763
+ "rstrip": false,
764
+ "single_word": false
765
+ },
766
+ {
767
+ "content": "<|replace|>",
768
+ "lstrip": false,
769
+ "normalized": false,
770
+ "rstrip": false,
771
+ "single_word": false
772
+ },
773
+ {
774
+ "content": "<|/replace|>",
775
+ "lstrip": false,
776
+ "normalized": false,
777
+ "rstrip": false,
778
+ "single_word": false
779
+ },
780
+ {
781
+ "content": "[e~[",
782
+ "lstrip": false,
783
+ "normalized": false,
784
+ "rstrip": false,
785
+ "single_word": false
786
+ },
787
+ {
788
+ "content": "]~e]",
789
+ "lstrip": false,
790
+ "normalized": false,
791
+ "rstrip": false,
792
+ "single_word": false
793
+ },
794
+ {
795
+ "content": "[d~[",
796
+ "lstrip": false,
797
+ "normalized": false,
798
+ "rstrip": false,
799
+ "single_word": false
800
+ },
801
+ {
802
+ "content": "]~d]",
803
+ "lstrip": false,
804
+ "normalized": false,
805
+ "rstrip": false,
806
+ "single_word": false
807
+ },
808
+ {
809
+ "content": "[p~[",
810
+ "lstrip": false,
811
+ "normalized": false,
812
+ "rstrip": false,
813
+ "single_word": false
814
+ },
815
+ {
816
+ "content": "]~p]",
817
+ "lstrip": false,
818
+ "normalized": false,
819
+ "rstrip": false,
820
+ "single_word": false
821
+ },
822
+ {
823
+ "content": "]~b]",
824
+ "lstrip": false,
825
+ "normalized": false,
826
+ "rstrip": false,
827
+ "single_word": false
828
+ },
829
+ {
830
+ "content": "]~!b[",
831
+ "lstrip": false,
832
+ "normalized": false,
833
+ "rstrip": false,
834
+ "single_word": false
835
+ },
836
+ {
837
+ "content": "[m~[",
838
+ "lstrip": false,
839
+ "normalized": false,
840
+ "rstrip": false,
841
+ "single_word": false
842
+ },
843
+ {
844
+ "content": "]~m]",
845
+ "lstrip": false,
846
+ "normalized": false,
847
+ "rstrip": false,
848
+ "single_word": false
849
+ },
850
+ {
851
+ "content": "<|doc|>",
852
+ "lstrip": false,
853
+ "normalized": false,
854
+ "rstrip": false,
855
+ "single_word": false
856
+ },
857
+ {
858
+ "content": "<|/doc|>",
859
+ "lstrip": false,
860
+ "normalized": false,
861
+ "rstrip": false,
862
+ "single_word": false
863
+ },
864
+ {
865
+ "content": "<|eod|>",
866
+ "lstrip": false,
867
+ "normalized": false,
868
+ "rstrip": false,
869
+ "single_word": false
870
+ },
871
+ {
872
+ "content": "<|file:txt|>",
873
+ "lstrip": false,
874
+ "normalized": false,
875
+ "rstrip": false,
876
+ "single_word": false
877
+ },
878
+ {
879
+ "content": "<|/file:txt|>",
880
+ "lstrip": false,
881
+ "normalized": false,
882
+ "rstrip": false,
883
+ "single_word": false
884
+ },
885
+ {
886
+ "content": "<|file:md|>",
887
+ "lstrip": false,
888
+ "normalized": false,
889
+ "rstrip": false,
890
+ "single_word": false
891
+ },
892
+ {
893
+ "content": "<|/file:md|>",
894
+ "lstrip": false,
895
+ "normalized": false,
896
+ "rstrip": false,
897
+ "single_word": false
898
+ },
899
+ {
900
+ "content": "<|file:json|>",
901
+ "lstrip": false,
902
+ "normalized": false,
903
+ "rstrip": false,
904
+ "single_word": false
905
+ },
906
+ {
907
+ "content": "<|/file:json|>",
908
+ "lstrip": false,
909
+ "normalized": false,
910
+ "rstrip": false,
911
+ "single_word": false
912
+ },
913
+ {
914
+ "content": "<|file:xml|>",
915
+ "lstrip": false,
916
+ "normalized": false,
917
+ "rstrip": false,
918
+ "single_word": false
919
+ },
920
+ {
921
+ "content": "<|/file:xml|>",
922
+ "lstrip": false,
923
+ "normalized": false,
924
+ "rstrip": false,
925
+ "single_word": false
926
+ },
927
+ {
928
+ "content": "<|file:yaml|>",
929
+ "lstrip": false,
930
+ "normalized": false,
931
+ "rstrip": false,
932
+ "single_word": false
933
+ },
934
+ {
935
+ "content": "<|/file:yaml|>",
936
+ "lstrip": false,
937
+ "normalized": false,
938
+ "rstrip": false,
939
+ "single_word": false
940
+ },
941
+ {
942
+ "content": "<|file:html|>",
943
+ "lstrip": false,
944
+ "normalized": false,
945
+ "rstrip": false,
946
+ "single_word": false
947
+ },
948
+ {
949
+ "content": "<|/file:html|>",
950
+ "lstrip": false,
951
+ "normalized": false,
952
+ "rstrip": false,
953
+ "single_word": false
954
+ },
955
+ {
956
+ "content": "<|file:css|>",
957
+ "lstrip": false,
958
+ "normalized": false,
959
+ "rstrip": false,
960
+ "single_word": false
961
+ },
962
+ {
963
+ "content": "<|/file:css|>",
964
+ "lstrip": false,
965
+ "normalized": false,
966
+ "rstrip": false,
967
+ "single_word": false
968
+ },
969
+ {
970
+ "content": "<|file:csv|>",
971
+ "lstrip": false,
972
+ "normalized": false,
973
+ "rstrip": false,
974
+ "single_word": false
975
+ },
976
+ {
977
+ "content": "<|/file:csv|>",
978
+ "lstrip": false,
979
+ "normalized": false,
980
+ "rstrip": false,
981
+ "single_word": false
982
+ },
983
+ {
984
+ "content": "<|file:toml|>",
985
+ "lstrip": false,
986
+ "normalized": false,
987
+ "rstrip": false,
988
+ "single_word": false
989
+ },
990
+ {
991
+ "content": "<|/file:toml|>",
992
+ "lstrip": false,
993
+ "normalized": false,
994
+ "rstrip": false,
995
+ "single_word": false
996
+ },
997
+ {
998
+ "content": "<|file:ini|>",
999
+ "lstrip": false,
1000
+ "normalized": false,
1001
+ "rstrip": false,
1002
+ "single_word": false
1003
+ },
1004
+ {
1005
+ "content": "<|/file:ini|>",
1006
+ "lstrip": false,
1007
+ "normalized": false,
1008
+ "rstrip": false,
1009
+ "single_word": false
1010
+ },
1011
+ {
1012
+ "content": "<|file:log|>",
1013
+ "lstrip": false,
1014
+ "normalized": false,
1015
+ "rstrip": false,
1016
+ "single_word": false
1017
+ },
1018
+ {
1019
+ "content": "<|/file:log|>",
1020
+ "lstrip": false,
1021
+ "normalized": false,
1022
+ "rstrip": false,
1023
+ "single_word": false
1024
+ },
1025
+ {
1026
+ "content": "<|filename|>",
1027
+ "lstrip": false,
1028
+ "normalized": false,
1029
+ "rstrip": false,
1030
+ "single_word": false
1031
+ },
1032
+ {
1033
+ "content": "<|/filename|>",
1034
+ "lstrip": false,
1035
+ "normalized": false,
1036
+ "rstrip": false,
1037
+ "single_word": false
1038
+ },
1039
+ {
1040
+ "content": "<|filepath|>",
1041
+ "lstrip": false,
1042
+ "normalized": false,
1043
+ "rstrip": false,
1044
+ "single_word": false
1045
+ },
1046
+ {
1047
+ "content": "<|/filepath|>",
1048
+ "lstrip": false,
1049
+ "normalized": false,
1050
+ "rstrip": false,
1051
+ "single_word": false
1052
+ },
1053
+ {
1054
+ "content": "<|image|>",
1055
+ "lstrip": false,
1056
+ "normalized": false,
1057
+ "rstrip": false,
1058
+ "single_word": false
1059
+ },
1060
+ {
1061
+ "content": "<|/image|>",
1062
+ "lstrip": false,
1063
+ "normalized": false,
1064
+ "rstrip": false,
1065
+ "single_word": false
1066
+ },
1067
+ {
1068
+ "content": "<|video|>",
1069
+ "lstrip": false,
1070
+ "normalized": false,
1071
+ "rstrip": false,
1072
+ "single_word": false
1073
+ },
1074
+ {
1075
+ "content": "<|/video|>",
1076
+ "lstrip": false,
1077
+ "normalized": false,
1078
+ "rstrip": false,
1079
+ "single_word": false
1080
+ },
1081
+ {
1082
+ "content": "<|timestamp|>",
1083
+ "lstrip": false,
1084
+ "normalized": false,
1085
+ "rstrip": false,
1086
+ "single_word": false
1087
+ },
1088
+ {
1089
+ "content": "<|/timestamp|>",
1090
+ "lstrip": false,
1091
+ "normalized": false,
1092
+ "rstrip": false,
1093
+ "single_word": false
1094
+ },
1095
+ {
1096
+ "content": "<|time_range|>",
1097
+ "lstrip": false,
1098
+ "normalized": false,
1099
+ "rstrip": false,
1100
+ "single_word": false
1101
+ },
1102
+ {
1103
+ "content": "<|/time_range|>",
1104
+ "lstrip": false,
1105
+ "normalized": false,
1106
+ "rstrip": false,
1107
+ "single_word": false
1108
+ },
1109
+ {
1110
+ "content": "<|keyframe|>",
1111
+ "lstrip": false,
1112
+ "normalized": false,
1113
+ "rstrip": false,
1114
+ "single_word": false
1115
+ },
1116
+ {
1117
+ "content": "<|/keyframe|>",
1118
+ "lstrip": false,
1119
+ "normalized": false,
1120
+ "rstrip": false,
1121
+ "single_word": false
1122
+ },
1123
+ {
1124
+ "content": "<|scene_change|>",
1125
+ "lstrip": false,
1126
+ "normalized": false,
1127
+ "rstrip": false,
1128
+ "single_word": false
1129
+ },
1130
+ {
1131
+ "content": "<|scene|>",
1132
+ "lstrip": false,
1133
+ "normalized": false,
1134
+ "rstrip": false,
1135
+ "single_word": false
1136
+ },
1137
+ {
1138
+ "content": "<|/scene|>",
1139
+ "lstrip": false,
1140
+ "normalized": false,
1141
+ "rstrip": false,
1142
+ "single_word": false
1143
+ },
1144
+ {
1145
+ "content": "<|segment|>",
1146
+ "lstrip": false,
1147
+ "normalized": false,
1148
+ "rstrip": false,
1149
+ "single_word": false
1150
+ },
1151
+ {
1152
+ "content": "<|/segment|>",
1153
+ "lstrip": false,
1154
+ "normalized": false,
1155
+ "rstrip": false,
1156
+ "single_word": false
1157
+ },
1158
+ {
1159
+ "content": "<|frame|>",
1160
+ "lstrip": false,
1161
+ "normalized": false,
1162
+ "rstrip": false,
1163
+ "single_word": false
1164
+ },
1165
+ {
1166
+ "content": "<|/frame|>",
1167
+ "lstrip": false,
1168
+ "normalized": false,
1169
+ "rstrip": false,
1170
+ "single_word": false
1171
+ },
1172
+ {
1173
+ "content": "<|frame_num|>",
1174
+ "lstrip": false,
1175
+ "normalized": false,
1176
+ "rstrip": false,
1177
+ "single_word": false
1178
+ },
1179
+ {
1180
+ "content": "<|/frame_num|>",
1181
+ "lstrip": false,
1182
+ "normalized": false,
1183
+ "rstrip": false,
1184
+ "single_word": false
1185
+ },
1186
+ {
1187
+ "content": "<|action|>",
1188
+ "lstrip": false,
1189
+ "normalized": false,
1190
+ "rstrip": false,
1191
+ "single_word": false
1192
+ },
1193
+ {
1194
+ "content": "<|/action|>",
1195
+ "lstrip": false,
1196
+ "normalized": false,
1197
+ "rstrip": false,
1198
+ "single_word": false
1199
+ },
1200
+ {
1201
+ "content": "<|event|>",
1202
+ "lstrip": false,
1203
+ "normalized": false,
1204
+ "rstrip": false,
1205
+ "single_word": false
1206
+ },
1207
+ {
1208
+ "content": "<|/event|>",
1209
+ "lstrip": false,
1210
+ "normalized": false,
1211
+ "rstrip": false,
1212
+ "single_word": false
1213
+ },
1214
+ {
1215
+ "content": "<|region|>",
1216
+ "lstrip": false,
1217
+ "normalized": false,
1218
+ "rstrip": false,
1219
+ "single_word": false
1220
+ },
1221
+ {
1222
+ "content": "<|/region|>",
1223
+ "lstrip": false,
1224
+ "normalized": false,
1225
+ "rstrip": false,
1226
+ "single_word": false
1227
+ },
1228
+ {
1229
+ "content": "<|bbox|>",
1230
+ "lstrip": false,
1231
+ "normalized": false,
1232
+ "rstrip": false,
1233
+ "single_word": false
1234
+ },
1235
+ {
1236
+ "content": "<|/bbox|>",
1237
+ "lstrip": false,
1238
+ "normalized": false,
1239
+ "rstrip": false,
1240
+ "single_word": false
1241
+ },
1242
+ {
1243
+ "content": "<|object|>",
1244
+ "lstrip": false,
1245
+ "normalized": false,
1246
+ "rstrip": false,
1247
+ "single_word": false
1248
+ },
1249
+ {
1250
+ "content": "<|/object|>",
1251
+ "lstrip": false,
1252
+ "normalized": false,
1253
+ "rstrip": false,
1254
+ "single_word": false
1255
+ },
1256
+ {
1257
+ "content": "<|gen_image|>",
1258
+ "lstrip": false,
1259
+ "normalized": false,
1260
+ "rstrip": false,
1261
+ "single_word": false
1262
+ },
1263
+ {
1264
+ "content": "<|/gen_image|>",
1265
+ "lstrip": false,
1266
+ "normalized": false,
1267
+ "rstrip": false,
1268
+ "single_word": false
1269
+ },
1270
+ {
1271
+ "content": "<|gen_video|>",
1272
+ "lstrip": false,
1273
+ "normalized": false,
1274
+ "rstrip": false,
1275
+ "single_word": false
1276
+ },
1277
+ {
1278
+ "content": "<|/gen_video|>",
1279
+ "lstrip": false,
1280
+ "normalized": false,
1281
+ "rstrip": false,
1282
+ "single_word": false
1283
+ },
1284
+ {
1285
+ "content": "<|tool_call|>",
1286
+ "lstrip": false,
1287
+ "normalized": false,
1288
+ "rstrip": false,
1289
+ "single_word": false
1290
+ },
1291
+ {
1292
+ "content": "<|/tool_call|>",
1293
+ "lstrip": false,
1294
+ "normalized": false,
1295
+ "rstrip": false,
1296
+ "single_word": false
1297
+ },
1298
+ {
1299
+ "content": "<|tool_result|>",
1300
+ "lstrip": false,
1301
+ "normalized": false,
1302
+ "rstrip": false,
1303
+ "single_word": false
1304
+ },
1305
+ {
1306
+ "content": "<|/tool_result|>",
1307
+ "lstrip": false,
1308
+ "normalized": false,
1309
+ "rstrip": false,
1310
+ "single_word": false
1311
+ },
1312
+ {
1313
+ "content": "<|function_name|>",
1314
+ "lstrip": false,
1315
+ "normalized": false,
1316
+ "rstrip": false,
1317
+ "single_word": false
1318
+ },
1319
+ {
1320
+ "content": "<|/function_name|>",
1321
+ "lstrip": false,
1322
+ "normalized": false,
1323
+ "rstrip": false,
1324
+ "single_word": false
1325
+ },
1326
+ {
1327
+ "content": "<|function_args|>",
1328
+ "lstrip": false,
1329
+ "normalized": false,
1330
+ "rstrip": false,
1331
+ "single_word": false
1332
+ },
1333
+ {
1334
+ "content": "<|/function_args|>",
1335
+ "lstrip": false,
1336
+ "normalized": false,
1337
+ "rstrip": false,
1338
+ "single_word": false
1339
+ },
1340
+ {
1341
+ "content": "<|arg_name|>",
1342
+ "lstrip": false,
1343
+ "normalized": false,
1344
+ "rstrip": false,
1345
+ "single_word": false
1346
+ },
1347
+ {
1348
+ "content": "<|/arg_name|>",
1349
+ "lstrip": false,
1350
+ "normalized": false,
1351
+ "rstrip": false,
1352
+ "single_word": false
1353
+ },
1354
+ {
1355
+ "content": "<|arg_value|>",
1356
+ "lstrip": false,
1357
+ "normalized": false,
1358
+ "rstrip": false,
1359
+ "single_word": false
1360
+ },
1361
+ {
1362
+ "content": "<|/arg_value|>",
1363
+ "lstrip": false,
1364
+ "normalized": false,
1365
+ "rstrip": false,
1366
+ "single_word": false
1367
+ },
1368
+ {
1369
+ "content": "<|tools|>",
1370
+ "lstrip": false,
1371
+ "normalized": false,
1372
+ "rstrip": false,
1373
+ "single_word": false
1374
+ },
1375
+ {
1376
+ "content": "<|/tools|>",
1377
+ "lstrip": false,
1378
+ "normalized": false,
1379
+ "rstrip": false,
1380
+ "single_word": false
1381
+ },
1382
+ {
1383
+ "content": "<|function_def|>",
1384
+ "lstrip": false,
1385
+ "normalized": false,
1386
+ "rstrip": false,
1387
+ "single_word": false
1388
+ },
1389
+ {
1390
+ "content": "<|/function_def|>",
1391
+ "lstrip": false,
1392
+ "normalized": false,
1393
+ "rstrip": false,
1394
+ "single_word": false
1395
+ },
1396
+ {
1397
+ "content": "<|available_tools|>",
1398
+ "lstrip": false,
1399
+ "normalized": false,
1400
+ "rstrip": false,
1401
+ "single_word": false
1402
+ },
1403
+ {
1404
+ "content": "<|/available_tools|>",
1405
+ "lstrip": false,
1406
+ "normalized": false,
1407
+ "rstrip": false,
1408
+ "single_word": false
1409
+ },
1410
+ {
1411
+ "content": "<|tool_def|>",
1412
+ "lstrip": false,
1413
+ "normalized": false,
1414
+ "rstrip": false,
1415
+ "single_word": false
1416
+ },
1417
+ {
1418
+ "content": "<|/tool_def|>",
1419
+ "lstrip": false,
1420
+ "normalized": false,
1421
+ "rstrip": false,
1422
+ "single_word": false
1423
+ },
1424
+ {
1425
+ "content": "<|tool_name|>",
1426
+ "lstrip": false,
1427
+ "normalized": false,
1428
+ "rstrip": false,
1429
+ "single_word": false
1430
+ },
1431
+ {
1432
+ "content": "<|/tool_name|>",
1433
+ "lstrip": false,
1434
+ "normalized": false,
1435
+ "rstrip": false,
1436
+ "single_word": false
1437
+ },
1438
+ {
1439
+ "content": "<|tool_desc|>",
1440
+ "lstrip": false,
1441
+ "normalized": false,
1442
+ "rstrip": false,
1443
+ "single_word": false
1444
+ },
1445
+ {
1446
+ "content": "<|/tool_desc|>",
1447
+ "lstrip": false,
1448
+ "normalized": false,
1449
+ "rstrip": false,
1450
+ "single_word": false
1451
+ },
1452
+ {
1453
+ "content": "<|tool_params|>",
1454
+ "lstrip": false,
1455
+ "normalized": false,
1456
+ "rstrip": false,
1457
+ "single_word": false
1458
+ },
1459
+ {
1460
+ "content": "<|/tool_params|>",
1461
+ "lstrip": false,
1462
+ "normalized": false,
1463
+ "rstrip": false,
1464
+ "single_word": false
1465
+ },
1466
+ {
1467
+ "content": "<|param_name|>",
1468
+ "lstrip": false,
1469
+ "normalized": false,
1470
+ "rstrip": false,
1471
+ "single_word": false
1472
+ },
1473
+ {
1474
+ "content": "<|/param_name|>",
1475
+ "lstrip": false,
1476
+ "normalized": false,
1477
+ "rstrip": false,
1478
+ "single_word": false
1479
+ },
1480
+ {
1481
+ "content": "<|param_type|>",
1482
+ "lstrip": false,
1483
+ "normalized": false,
1484
+ "rstrip": false,
1485
+ "single_word": false
1486
+ },
1487
+ {
1488
+ "content": "<|/param_type|>",
1489
+ "lstrip": false,
1490
+ "normalized": false,
1491
+ "rstrip": false,
1492
+ "single_word": false
1493
+ },
1494
+ {
1495
+ "content": "<|param_required|>",
1496
+ "lstrip": false,
1497
+ "normalized": false,
1498
+ "rstrip": false,
1499
+ "single_word": false
1500
+ },
1501
+ {
1502
+ "content": "<|param_optional|>",
1503
+ "lstrip": false,
1504
+ "normalized": false,
1505
+ "rstrip": false,
1506
+ "single_word": false
1507
+ },
1508
+ {
1509
+ "content": "<|tool_error|>",
1510
+ "lstrip": false,
1511
+ "normalized": false,
1512
+ "rstrip": false,
1513
+ "single_word": false
1514
+ },
1515
+ {
1516
+ "content": "<|/tool_error|>",
1517
+ "lstrip": false,
1518
+ "normalized": false,
1519
+ "rstrip": false,
1520
+ "single_word": false
1521
+ },
1522
+ {
1523
+ "content": "<|tool_success|>",
1524
+ "lstrip": false,
1525
+ "normalized": false,
1526
+ "rstrip": false,
1527
+ "single_word": false
1528
+ },
1529
+ {
1530
+ "content": "<|tool_calls|>",
1531
+ "lstrip": false,
1532
+ "normalized": false,
1533
+ "rstrip": false,
1534
+ "single_word": false
1535
+ },
1536
+ {
1537
+ "content": "<|/tool_calls|>",
1538
+ "lstrip": false,
1539
+ "normalized": false,
1540
+ "rstrip": false,
1541
+ "single_word": false
1542
+ },
1543
+ {
1544
+ "content": "<|tool_id|>",
1545
+ "lstrip": false,
1546
+ "normalized": false,
1547
+ "rstrip": false,
1548
+ "single_word": false
1549
+ },
1550
+ {
1551
+ "content": "<|/tool_id|>",
1552
+ "lstrip": false,
1553
+ "normalized": false,
1554
+ "rstrip": false,
1555
+ "single_word": false
1556
+ },
1557
+ {
1558
+ "content": "<|code|>",
1559
+ "lstrip": false,
1560
+ "normalized": false,
1561
+ "rstrip": false,
1562
+ "single_word": false
1563
+ },
1564
+ {
1565
+ "content": "<|/code|>",
1566
+ "lstrip": false,
1567
+ "normalized": false,
1568
+ "rstrip": false,
1569
+ "single_word": false
1570
+ },
1571
+ {
1572
+ "content": "<|lang:python|>",
1573
+ "lstrip": false,
1574
+ "normalized": false,
1575
+ "rstrip": false,
1576
+ "single_word": false
1577
+ },
1578
+ {
1579
+ "content": "<|lang:javascript|>",
1580
+ "lstrip": false,
1581
+ "normalized": false,
1582
+ "rstrip": false,
1583
+ "single_word": false
1584
+ },
1585
+ {
1586
+ "content": "<|lang:typescript|>",
1587
+ "lstrip": false,
1588
+ "normalized": false,
1589
+ "rstrip": false,
1590
+ "single_word": false
1591
+ },
1592
+ {
1593
+ "content": "<|lang:java|>",
1594
+ "lstrip": false,
1595
+ "normalized": false,
1596
+ "rstrip": false,
1597
+ "single_word": false
1598
+ },
1599
+ {
1600
+ "content": "<|lang:cpp|>",
1601
+ "lstrip": false,
1602
+ "normalized": false,
1603
+ "rstrip": false,
1604
+ "single_word": false
1605
+ },
1606
+ {
1607
+ "content": "<|lang:c|>",
1608
+ "lstrip": false,
1609
+ "normalized": false,
1610
+ "rstrip": false,
1611
+ "single_word": false
1612
+ },
1613
+ {
1614
+ "content": "<|lang:csharp|>",
1615
+ "lstrip": false,
1616
+ "normalized": false,
1617
+ "rstrip": false,
1618
+ "single_word": false
1619
+ },
1620
+ {
1621
+ "content": "<|lang:go|>",
1622
+ "lstrip": false,
1623
+ "normalized": false,
1624
+ "rstrip": false,
1625
+ "single_word": false
1626
+ },
1627
+ {
1628
+ "content": "<|lang:rust|>",
1629
+ "lstrip": false,
1630
+ "normalized": false,
1631
+ "rstrip": false,
1632
+ "single_word": false
1633
+ },
1634
+ {
1635
+ "content": "<|lang:ruby|>",
1636
+ "lstrip": false,
1637
+ "normalized": false,
1638
+ "rstrip": false,
1639
+ "single_word": false
1640
+ },
1641
+ {
1642
+ "content": "<|lang:php|>",
1643
+ "lstrip": false,
1644
+ "normalized": false,
1645
+ "rstrip": false,
1646
+ "single_word": false
1647
+ },
1648
+ {
1649
+ "content": "<|lang:swift|>",
1650
+ "lstrip": false,
1651
+ "normalized": false,
1652
+ "rstrip": false,
1653
+ "single_word": false
1654
+ },
1655
+ {
1656
+ "content": "<|lang:kotlin|>",
1657
+ "lstrip": false,
1658
+ "normalized": false,
1659
+ "rstrip": false,
1660
+ "single_word": false
1661
+ },
1662
+ {
1663
+ "content": "<|lang:scala|>",
1664
+ "lstrip": false,
1665
+ "normalized": false,
1666
+ "rstrip": false,
1667
+ "single_word": false
1668
+ },
1669
+ {
1670
+ "content": "<|lang:shell|>",
1671
+ "lstrip": false,
1672
+ "normalized": false,
1673
+ "rstrip": false,
1674
+ "single_word": false
1675
+ },
1676
+ {
1677
+ "content": "<|lang:bash|>",
1678
+ "lstrip": false,
1679
+ "normalized": false,
1680
+ "rstrip": false,
1681
+ "single_word": false
1682
+ },
1683
+ {
1684
+ "content": "<|lang:sql|>",
1685
+ "lstrip": false,
1686
+ "normalized": false,
1687
+ "rstrip": false,
1688
+ "single_word": false
1689
+ },
1690
+ {
1691
+ "content": "<|lang:r|>",
1692
+ "lstrip": false,
1693
+ "normalized": false,
1694
+ "rstrip": false,
1695
+ "single_word": false
1696
+ },
1697
+ {
1698
+ "content": "<|lang:matlab|>",
1699
+ "lstrip": false,
1700
+ "normalized": false,
1701
+ "rstrip": false,
1702
+ "single_word": false
1703
+ },
1704
+ {
1705
+ "content": "<|lang:lua|>",
1706
+ "lstrip": false,
1707
+ "normalized": false,
1708
+ "rstrip": false,
1709
+ "single_word": false
1710
+ },
1711
+ {
1712
+ "content": "<|lang:perl|>",
1713
+ "lstrip": false,
1714
+ "normalized": false,
1715
+ "rstrip": false,
1716
+ "single_word": false
1717
+ },
1718
+ {
1719
+ "content": "<|lang:haskell|>",
1720
+ "lstrip": false,
1721
+ "normalized": false,
1722
+ "rstrip": false,
1723
+ "single_word": false
1724
+ },
1725
+ {
1726
+ "content": "<|lang:other|>",
1727
+ "lstrip": false,
1728
+ "normalized": false,
1729
+ "rstrip": false,
1730
+ "single_word": false
1731
+ },
1732
+ {
1733
+ "content": "<|think|>",
1734
+ "lstrip": false,
1735
+ "normalized": false,
1736
+ "rstrip": false,
1737
+ "single_word": false
1738
+ },
1739
+ {
1740
+ "content": "<|/think|>",
1741
+ "lstrip": false,
1742
+ "normalized": false,
1743
+ "rstrip": false,
1744
+ "single_word": false
1745
+ },
1746
+ {
1747
+ "content": "<|observation|>",
1748
+ "lstrip": false,
1749
+ "normalized": false,
1750
+ "rstrip": false,
1751
+ "single_word": false
1752
+ },
1753
+ {
1754
+ "content": "<|/observation|>",
1755
+ "lstrip": false,
1756
+ "normalized": false,
1757
+ "rstrip": false,
1758
+ "single_word": false
1759
+ },
1760
+ {
1761
+ "content": "<|note|>",
1762
+ "lstrip": false,
1763
+ "normalized": false,
1764
+ "rstrip": false,
1765
+ "single_word": false
1766
+ },
1767
+ {
1768
+ "content": "<|/note|>",
1769
+ "lstrip": false,
1770
+ "normalized": false,
1771
+ "rstrip": false,
1772
+ "single_word": false
1773
+ },
1774
+ {
1775
+ "content": "<|step|>",
1776
+ "lstrip": false,
1777
+ "normalized": false,
1778
+ "rstrip": false,
1779
+ "single_word": false
1780
+ },
1781
+ {
1782
+ "content": "<|/step|>",
1783
+ "lstrip": false,
1784
+ "normalized": false,
1785
+ "rstrip": false,
1786
+ "single_word": false
1787
+ },
1788
+ {
1789
+ "content": "<|reflection|>",
1790
+ "lstrip": false,
1791
+ "normalized": false,
1792
+ "rstrip": false,
1793
+ "single_word": false
1794
+ },
1795
+ {
1796
+ "content": "<|/reflection|>",
1797
+ "lstrip": false,
1798
+ "normalized": false,
1799
+ "rstrip": false,
1800
+ "single_word": false
1801
+ },
1802
+ {
1803
+ "content": "<|hypothesis|>",
1804
+ "lstrip": false,
1805
+ "normalized": false,
1806
+ "rstrip": false,
1807
+ "single_word": false
1808
+ },
1809
+ {
1810
+ "content": "<|/hypothesis|>",
1811
+ "lstrip": false,
1812
+ "normalized": false,
1813
+ "rstrip": false,
1814
+ "single_word": false
1815
+ },
1816
+ {
1817
+ "content": "<|conclusion|>",
1818
+ "lstrip": false,
1819
+ "normalized": false,
1820
+ "rstrip": false,
1821
+ "single_word": false
1822
+ },
1823
+ {
1824
+ "content": "<|/conclusion|>",
1825
+ "lstrip": false,
1826
+ "normalized": false,
1827
+ "rstrip": false,
1828
+ "single_word": false
1829
+ },
1830
+ {
1831
+ "content": "<|plan|>",
1832
+ "lstrip": false,
1833
+ "normalized": false,
1834
+ "rstrip": false,
1835
+ "single_word": false
1836
+ },
1837
+ {
1838
+ "content": "<|/plan|>",
1839
+ "lstrip": false,
1840
+ "normalized": false,
1841
+ "rstrip": false,
1842
+ "single_word": false
1843
+ },
1844
+ {
1845
+ "content": "<|plan_step|>",
1846
+ "lstrip": false,
1847
+ "normalized": false,
1848
+ "rstrip": false,
1849
+ "single_word": false
1850
+ },
1851
+ {
1852
+ "content": "<|/plan_step|>",
1853
+ "lstrip": false,
1854
+ "normalized": false,
1855
+ "rstrip": false,
1856
+ "single_word": false
1857
+ },
1858
+ {
1859
+ "content": "<|critique|>",
1860
+ "lstrip": false,
1861
+ "normalized": false,
1862
+ "rstrip": false,
1863
+ "single_word": false
1864
+ },
1865
+ {
1866
+ "content": "<|/critique|>",
1867
+ "lstrip": false,
1868
+ "normalized": false,
1869
+ "rstrip": false,
1870
+ "single_word": false
1871
+ },
1872
+ {
1873
+ "content": "<|error_found|>",
1874
+ "lstrip": false,
1875
+ "normalized": false,
1876
+ "rstrip": false,
1877
+ "single_word": false
1878
+ },
1879
+ {
1880
+ "content": "<|no_error|>",
1881
+ "lstrip": false,
1882
+ "normalized": false,
1883
+ "rstrip": false,
1884
+ "single_word": false
1885
+ },
1886
+ {
1887
+ "content": "<|analysis|>",
1888
+ "lstrip": false,
1889
+ "normalized": false,
1890
+ "rstrip": false,
1891
+ "single_word": false
1892
+ },
1893
+ {
1894
+ "content": "<|/analysis|>",
1895
+ "lstrip": false,
1896
+ "normalized": false,
1897
+ "rstrip": false,
1898
+ "single_word": false
1899
+ },
1900
+ {
1901
+ "content": "<|breakdown|>",
1902
+ "lstrip": false,
1903
+ "normalized": false,
1904
+ "rstrip": false,
1905
+ "single_word": false
1906
+ },
1907
+ {
1908
+ "content": "<|/breakdown|>",
1909
+ "lstrip": false,
1910
+ "normalized": false,
1911
+ "rstrip": false,
1912
+ "single_word": false
1913
+ },
1914
+ {
1915
+ "content": "<|decision|>",
1916
+ "lstrip": false,
1917
+ "normalized": false,
1918
+ "rstrip": false,
1919
+ "single_word": false
1920
+ },
1921
+ {
1922
+ "content": "<|/decision|>",
1923
+ "lstrip": false,
1924
+ "normalized": false,
1925
+ "rstrip": false,
1926
+ "single_word": false
1927
+ },
1928
+ {
1929
+ "content": "<|option|>",
1930
+ "lstrip": false,
1931
+ "normalized": false,
1932
+ "rstrip": false,
1933
+ "single_word": false
1934
+ },
1935
+ {
1936
+ "content": "<|/option|>",
1937
+ "lstrip": false,
1938
+ "normalized": false,
1939
+ "rstrip": false,
1940
+ "single_word": false
1941
+ },
1942
+ {
1943
+ "content": "<|chosen|>",
1944
+ "lstrip": false,
1945
+ "normalized": false,
1946
+ "rstrip": false,
1947
+ "single_word": false
1948
+ },
1949
+ {
1950
+ "content": "<|rejected|>",
1951
+ "lstrip": false,
1952
+ "normalized": false,
1953
+ "rstrip": false,
1954
+ "single_word": false
1955
+ },
1956
+ {
1957
+ "content": "<|because|>",
1958
+ "lstrip": false,
1959
+ "normalized": false,
1960
+ "rstrip": false,
1961
+ "single_word": false
1962
+ },
1963
+ {
1964
+ "content": "<|therefore|>",
1965
+ "lstrip": false,
1966
+ "normalized": false,
1967
+ "rstrip": false,
1968
+ "single_word": false
1969
+ },
1970
+ {
1971
+ "content": "<|however|>",
1972
+ "lstrip": false,
1973
+ "normalized": false,
1974
+ "rstrip": false,
1975
+ "single_word": false
1976
+ },
1977
+ {
1978
+ "content": "<|alternatively|>",
1979
+ "lstrip": false,
1980
+ "normalized": false,
1981
+ "rstrip": false,
1982
+ "single_word": false
1983
+ },
1984
+ {
1985
+ "content": "<|confidence:high|>",
1986
+ "lstrip": false,
1987
+ "normalized": false,
1988
+ "rstrip": false,
1989
+ "single_word": false
1990
+ },
1991
+ {
1992
+ "content": "<|confidence:medium|>",
1993
+ "lstrip": false,
1994
+ "normalized": false,
1995
+ "rstrip": false,
1996
+ "single_word": false
1997
+ },
1998
+ {
1999
+ "content": "<|confidence:low|>",
2000
+ "lstrip": false,
2001
+ "normalized": false,
2002
+ "rstrip": false,
2003
+ "single_word": false
2004
+ },
2005
+ {
2006
+ "content": "<|confidence:uncertain|>",
2007
+ "lstrip": false,
2008
+ "normalized": false,
2009
+ "rstrip": false,
2010
+ "single_word": false
2011
+ },
2012
+ {
2013
+ "content": "<|uncertainty_score|>",
2014
+ "lstrip": false,
2015
+ "normalized": false,
2016
+ "rstrip": false,
2017
+ "single_word": false
2018
+ },
2019
+ {
2020
+ "content": "<|/uncertainty_score|>",
2021
+ "lstrip": false,
2022
+ "normalized": false,
2023
+ "rstrip": false,
2024
+ "single_word": false
2025
+ },
2026
+ {
2027
+ "content": "<|certainty_score|>",
2028
+ "lstrip": false,
2029
+ "normalized": false,
2030
+ "rstrip": false,
2031
+ "single_word": false
2032
+ },
2033
+ {
2034
+ "content": "<|/certainty_score|>",
2035
+ "lstrip": false,
2036
+ "normalized": false,
2037
+ "rstrip": false,
2038
+ "single_word": false
2039
+ },
2040
+ {
2041
+ "content": "<|uncertain|>",
2042
+ "lstrip": false,
2043
+ "normalized": false,
2044
+ "rstrip": false,
2045
+ "single_word": false
2046
+ },
2047
+ {
2048
+ "content": "<|/uncertain|>",
2049
+ "lstrip": false,
2050
+ "normalized": false,
2051
+ "rstrip": false,
2052
+ "single_word": false
2053
+ },
2054
+ {
2055
+ "content": "<|unknown|>",
2056
+ "lstrip": false,
2057
+ "normalized": false,
2058
+ "rstrip": false,
2059
+ "single_word": false
2060
+ },
2061
+ {
2062
+ "content": "<|need_verify|>",
2063
+ "lstrip": false,
2064
+ "normalized": false,
2065
+ "rstrip": false,
2066
+ "single_word": false
2067
+ },
2068
+ {
2069
+ "content": "<|may_outdated|>",
2070
+ "lstrip": false,
2071
+ "normalized": false,
2072
+ "rstrip": false,
2073
+ "single_word": false
2074
+ },
2075
+ {
2076
+ "content": "<|speculative|>",
2077
+ "lstrip": false,
2078
+ "normalized": false,
2079
+ "rstrip": false,
2080
+ "single_word": false
2081
+ },
2082
+ {
2083
+ "content": "<|approximate|>",
2084
+ "lstrip": false,
2085
+ "normalized": false,
2086
+ "rstrip": false,
2087
+ "single_word": false
2088
+ },
2089
+ {
2090
+ "content": "<|verify|>",
2091
+ "lstrip": false,
2092
+ "normalized": false,
2093
+ "rstrip": false,
2094
+ "single_word": false
2095
+ },
2096
+ {
2097
+ "content": "<|/verify|>",
2098
+ "lstrip": false,
2099
+ "normalized": false,
2100
+ "rstrip": false,
2101
+ "single_word": false
2102
+ },
2103
+ {
2104
+ "content": "<|fact_check|>",
2105
+ "lstrip": false,
2106
+ "normalized": false,
2107
+ "rstrip": false,
2108
+ "single_word": false
2109
+ },
2110
+ {
2111
+ "content": "<|self_correct|>",
2112
+ "lstrip": false,
2113
+ "normalized": false,
2114
+ "rstrip": false,
2115
+ "single_word": false
2116
+ },
2117
+ {
2118
+ "content": "<|correction|>",
2119
+ "lstrip": false,
2120
+ "normalized": false,
2121
+ "rstrip": false,
2122
+ "single_word": false
2123
+ },
2124
+ {
2125
+ "content": "<|/correction|>",
2126
+ "lstrip": false,
2127
+ "normalized": false,
2128
+ "rstrip": false,
2129
+ "single_word": false
2130
+ },
2131
+ {
2132
+ "content": "<|retract|>",
2133
+ "lstrip": false,
2134
+ "normalized": false,
2135
+ "rstrip": false,
2136
+ "single_word": false
2137
+ },
2138
+ {
2139
+ "content": "<|clarify|>",
2140
+ "lstrip": false,
2141
+ "normalized": false,
2142
+ "rstrip": false,
2143
+ "single_word": false
2144
+ },
2145
+ {
2146
+ "content": "<|cite|>",
2147
+ "lstrip": false,
2148
+ "normalized": false,
2149
+ "rstrip": false,
2150
+ "single_word": false
2151
+ },
2152
+ {
2153
+ "content": "<|/cite|>",
2154
+ "lstrip": false,
2155
+ "normalized": false,
2156
+ "rstrip": false,
2157
+ "single_word": false
2158
+ },
2159
+ {
2160
+ "content": "<|source|>",
2161
+ "lstrip": false,
2162
+ "normalized": false,
2163
+ "rstrip": false,
2164
+ "single_word": false
2165
+ },
2166
+ {
2167
+ "content": "<|/source|>",
2168
+ "lstrip": false,
2169
+ "normalized": false,
2170
+ "rstrip": false,
2171
+ "single_word": false
2172
+ },
2173
+ {
2174
+ "content": "<|ref|>",
2175
+ "lstrip": false,
2176
+ "normalized": false,
2177
+ "rstrip": false,
2178
+ "single_word": false
2179
+ },
2180
+ {
2181
+ "content": "<|/ref|>",
2182
+ "lstrip": false,
2183
+ "normalized": false,
2184
+ "rstrip": false,
2185
+ "single_word": false
2186
+ },
2187
+ {
2188
+ "content": "<|quote|>",
2189
+ "lstrip": false,
2190
+ "normalized": false,
2191
+ "rstrip": false,
2192
+ "single_word": false
2193
+ },
2194
+ {
2195
+ "content": "<|/quote|>",
2196
+ "lstrip": false,
2197
+ "normalized": false,
2198
+ "rstrip": false,
2199
+ "single_word": false
2200
+ },
2201
+ {
2202
+ "content": "<|attribution|>",
2203
+ "lstrip": false,
2204
+ "normalized": false,
2205
+ "rstrip": false,
2206
+ "single_word": false
2207
+ },
2208
+ {
2209
+ "content": "<|/attribution|>",
2210
+ "lstrip": false,
2211
+ "normalized": false,
2212
+ "rstrip": false,
2213
+ "single_word": false
2214
+ },
2215
+ {
2216
+ "content": "<|context|>",
2217
+ "lstrip": false,
2218
+ "normalized": false,
2219
+ "rstrip": false,
2220
+ "single_word": false
2221
+ },
2222
+ {
2223
+ "content": "<|/context|>",
2224
+ "lstrip": false,
2225
+ "normalized": false,
2226
+ "rstrip": false,
2227
+ "single_word": false
2228
+ },
2229
+ {
2230
+ "content": "<|retrieved|>",
2231
+ "lstrip": false,
2232
+ "normalized": false,
2233
+ "rstrip": false,
2234
+ "single_word": false
2235
+ },
2236
+ {
2237
+ "content": "<|/retrieved|>",
2238
+ "lstrip": false,
2239
+ "normalized": false,
2240
+ "rstrip": false,
2241
+ "single_word": false
2242
+ },
2243
+ {
2244
+ "content": "<|grounded|>",
2245
+ "lstrip": false,
2246
+ "normalized": false,
2247
+ "rstrip": false,
2248
+ "single_word": false
2249
+ },
2250
+ {
2251
+ "content": "<|ungrounded|>",
2252
+ "lstrip": false,
2253
+ "normalized": false,
2254
+ "rstrip": false,
2255
+ "single_word": false
2256
+ },
2257
+ {
2258
+ "content": "<|partially_grounded|>",
2259
+ "lstrip": false,
2260
+ "normalized": false,
2261
+ "rstrip": false,
2262
+ "single_word": false
2263
+ },
2264
+ {
2265
+ "content": "<|knowledge_cutoff|>",
2266
+ "lstrip": false,
2267
+ "normalized": false,
2268
+ "rstrip": false,
2269
+ "single_word": false
2270
+ },
2271
+ {
2272
+ "content": "<|beyond_knowledge|>",
2273
+ "lstrip": false,
2274
+ "normalized": false,
2275
+ "rstrip": false,
2276
+ "single_word": false
2277
+ },
2278
+ {
2279
+ "content": "<|within_knowledge|>",
2280
+ "lstrip": false,
2281
+ "normalized": false,
2282
+ "rstrip": false,
2283
+ "single_word": false
2284
+ },
2285
+ {
2286
+ "content": "<|knowledge_date|>",
2287
+ "lstrip": false,
2288
+ "normalized": false,
2289
+ "rstrip": false,
2290
+ "single_word": false
2291
+ },
2292
+ {
2293
+ "content": "<|/knowledge_date|>",
2294
+ "lstrip": false,
2295
+ "normalized": false,
2296
+ "rstrip": false,
2297
+ "single_word": false
2298
+ },
2299
+ {
2300
+ "content": "<|listen|>",
2301
+ "lstrip": false,
2302
+ "normalized": false,
2303
+ "rstrip": false,
2304
+ "single_word": false
2305
+ },
2306
+ {
2307
+ "content": "<|/listen|>",
2308
+ "lstrip": false,
2309
+ "normalized": false,
2310
+ "rstrip": false,
2311
+ "single_word": false
2312
+ },
2313
+ {
2314
+ "content": "<|speak|>",
2315
+ "lstrip": false,
2316
+ "normalized": false,
2317
+ "rstrip": false,
2318
+ "single_word": false
2319
+ },
2320
+ {
2321
+ "content": "<|/speak|>",
2322
+ "lstrip": false,
2323
+ "normalized": false,
2324
+ "rstrip": false,
2325
+ "single_word": false
2326
+ },
2327
+ {
2328
+ "content": "<|audio|>",
2329
+ "lstrip": false,
2330
+ "normalized": false,
2331
+ "rstrip": false,
2332
+ "single_word": false
2333
+ },
2334
+ {
2335
+ "content": "<|/audio|>",
2336
+ "lstrip": false,
2337
+ "normalized": false,
2338
+ "rstrip": false,
2339
+ "single_word": false
2340
+ },
2341
+ {
2342
+ "content": "<|audio_prompt|>",
2343
+ "lstrip": false,
2344
+ "normalized": false,
2345
+ "rstrip": false,
2346
+ "single_word": false
2347
+ },
2348
+ {
2349
+ "content": "<|/audio_prompt|>",
2350
+ "lstrip": false,
2351
+ "normalized": false,
2352
+ "rstrip": false,
2353
+ "single_word": false
2354
+ },
2355
+ {
2356
+ "content": "<|speaker_ref|>",
2357
+ "lstrip": false,
2358
+ "normalized": false,
2359
+ "rstrip": false,
2360
+ "single_word": false
2361
+ },
2362
+ {
2363
+ "content": "<|/speaker_ref|>",
2364
+ "lstrip": false,
2365
+ "normalized": false,
2366
+ "rstrip": false,
2367
+ "single_word": false
2368
+ },
2369
+ {
2370
+ "content": "<|eot|>",
2371
+ "lstrip": false,
2372
+ "normalized": false,
2373
+ "rstrip": false,
2374
+ "single_word": false
2375
+ },
2376
+ {
2377
+ "content": "<|continue|>",
2378
+ "lstrip": false,
2379
+ "normalized": false,
2380
+ "rstrip": false,
2381
+ "single_word": false
2382
+ },
2383
+ {
2384
+ "content": "<|yield|>",
2385
+ "lstrip": false,
2386
+ "normalized": false,
2387
+ "rstrip": false,
2388
+ "single_word": false
2389
+ },
2390
+ {
2391
+ "content": "<|interrupt|>",
2392
+ "lstrip": false,
2393
+ "normalized": false,
2394
+ "rstrip": false,
2395
+ "single_word": false
2396
+ },
2397
+ {
2398
+ "content": "<|backoff|>",
2399
+ "lstrip": false,
2400
+ "normalized": false,
2401
+ "rstrip": false,
2402
+ "single_word": false
2403
+ },
2404
+ {
2405
+ "content": "<|user_int|>",
2406
+ "lstrip": false,
2407
+ "normalized": false,
2408
+ "rstrip": false,
2409
+ "single_word": false
2410
+ },
2411
+ {
2412
+ "content": "<|/user_int|>",
2413
+ "lstrip": false,
2414
+ "normalized": false,
2415
+ "rstrip": false,
2416
+ "single_word": false
2417
+ },
2418
+ {
2419
+ "content": "<|cough|>",
2420
+ "lstrip": false,
2421
+ "normalized": false,
2422
+ "rstrip": false,
2423
+ "single_word": false
2424
+ },
2425
+ {
2426
+ "content": "<|laugh|>",
2427
+ "lstrip": false,
2428
+ "normalized": false,
2429
+ "rstrip": false,
2430
+ "single_word": false
2431
+ },
2432
+ {
2433
+ "content": "<|sigh|>",
2434
+ "lstrip": false,
2435
+ "normalized": false,
2436
+ "rstrip": false,
2437
+ "single_word": false
2438
+ },
2439
+ {
2440
+ "content": "<|hesitation|>",
2441
+ "lstrip": false,
2442
+ "normalized": false,
2443
+ "rstrip": false,
2444
+ "single_word": false
2445
+ },
2446
+ {
2447
+ "content": "<|backchannel|>",
2448
+ "lstrip": false,
2449
+ "normalized": false,
2450
+ "rstrip": false,
2451
+ "single_word": false
2452
+ },
2453
+ {
2454
+ "content": "<|confused|>",
2455
+ "lstrip": false,
2456
+ "normalized": false,
2457
+ "rstrip": false,
2458
+ "single_word": false
2459
+ },
2460
+ {
2461
+ "content": "<|agree|>",
2462
+ "lstrip": false,
2463
+ "normalized": false,
2464
+ "rstrip": false,
2465
+ "single_word": false
2466
+ },
2467
+ {
2468
+ "content": "<|disagree|>",
2469
+ "lstrip": false,
2470
+ "normalized": false,
2471
+ "rstrip": false,
2472
+ "single_word": false
2473
+ },
2474
+ {
2475
+ "content": "<|pause|>",
2476
+ "lstrip": false,
2477
+ "normalized": false,
2478
+ "rstrip": false,
2479
+ "single_word": false
2480
+ },
2481
+ {
2482
+ "content": "<|resume|>",
2483
+ "lstrip": false,
2484
+ "normalized": false,
2485
+ "rstrip": false,
2486
+ "single_word": false
2487
+ },
2488
+ {
2489
+ "content": "<|rewind|>",
2490
+ "lstrip": false,
2491
+ "normalized": false,
2492
+ "rstrip": false,
2493
+ "single_word": false
2494
+ },
2495
+ {
2496
+ "content": "<|adjust|>",
2497
+ "lstrip": false,
2498
+ "normalized": false,
2499
+ "rstrip": false,
2500
+ "single_word": false
2501
+ },
2502
+ {
2503
+ "content": "<|emotion|>",
2504
+ "lstrip": false,
2505
+ "normalized": false,
2506
+ "rstrip": false,
2507
+ "single_word": false
2508
+ },
2509
+ {
2510
+ "content": "<|/emotion|>",
2511
+ "lstrip": false,
2512
+ "normalized": false,
2513
+ "rstrip": false,
2514
+ "single_word": false
2515
+ },
2516
+ {
2517
+ "content": "<|arousal|>",
2518
+ "lstrip": false,
2519
+ "normalized": false,
2520
+ "rstrip": false,
2521
+ "single_word": false
2522
+ },
2523
+ {
2524
+ "content": "<|/arousal|>",
2525
+ "lstrip": false,
2526
+ "normalized": false,
2527
+ "rstrip": false,
2528
+ "single_word": false
2529
+ },
2530
+ {
2531
+ "content": "<|valence|>",
2532
+ "lstrip": false,
2533
+ "normalized": false,
2534
+ "rstrip": false,
2535
+ "single_word": false
2536
+ },
2537
+ {
2538
+ "content": "<|/valence|>",
2539
+ "lstrip": false,
2540
+ "normalized": false,
2541
+ "rstrip": false,
2542
+ "single_word": false
2543
+ },
2544
+ {
2545
+ "content": "<|dominance|>",
2546
+ "lstrip": false,
2547
+ "normalized": false,
2548
+ "rstrip": false,
2549
+ "single_word": false
2550
+ },
2551
+ {
2552
+ "content": "<|/dominance|>",
2553
+ "lstrip": false,
2554
+ "normalized": false,
2555
+ "rstrip": false,
2556
+ "single_word": false
2557
+ },
2558
+ {
2559
+ "content": "<|happy|>",
2560
+ "lstrip": false,
2561
+ "normalized": false,
2562
+ "rstrip": false,
2563
+ "single_word": false
2564
+ },
2565
+ {
2566
+ "content": "<|sad|>",
2567
+ "lstrip": false,
2568
+ "normalized": false,
2569
+ "rstrip": false,
2570
+ "single_word": false
2571
+ },
2572
+ {
2573
+ "content": "<|angry|>",
2574
+ "lstrip": false,
2575
+ "normalized": false,
2576
+ "rstrip": false,
2577
+ "single_word": false
2578
+ },
2579
+ {
2580
+ "content": "<|fearful|>",
2581
+ "lstrip": false,
2582
+ "normalized": false,
2583
+ "rstrip": false,
2584
+ "single_word": false
2585
+ },
2586
+ {
2587
+ "content": "<|surprised|>",
2588
+ "lstrip": false,
2589
+ "normalized": false,
2590
+ "rstrip": false,
2591
+ "single_word": false
2592
+ },
2593
+ {
2594
+ "content": "<|disgusted|>",
2595
+ "lstrip": false,
2596
+ "normalized": false,
2597
+ "rstrip": false,
2598
+ "single_word": false
2599
+ },
2600
+ {
2601
+ "content": "<|neutral|>",
2602
+ "lstrip": false,
2603
+ "normalized": false,
2604
+ "rstrip": false,
2605
+ "single_word": false
2606
+ },
2607
+ {
2608
+ "content": "<|excited|>",
2609
+ "lstrip": false,
2610
+ "normalized": false,
2611
+ "rstrip": false,
2612
+ "single_word": false
2613
+ },
2614
+ {
2615
+ "content": "<|frustrated|>",
2616
+ "lstrip": false,
2617
+ "normalized": false,
2618
+ "rstrip": false,
2619
+ "single_word": false
2620
+ },
2621
+ {
2622
+ "content": "<|bored|>",
2623
+ "lstrip": false,
2624
+ "normalized": false,
2625
+ "rstrip": false,
2626
+ "single_word": false
2627
+ },
2628
+ {
2629
+ "content": "<|match_emo|>",
2630
+ "lstrip": false,
2631
+ "normalized": false,
2632
+ "rstrip": false,
2633
+ "single_word": false
2634
+ },
2635
+ {
2636
+ "content": "<|contrast_emo|>",
2637
+ "lstrip": false,
2638
+ "normalized": false,
2639
+ "rstrip": false,
2640
+ "single_word": false
2641
+ },
2642
+ {
2643
+ "content": "<|calm|>",
2644
+ "lstrip": false,
2645
+ "normalized": false,
2646
+ "rstrip": false,
2647
+ "single_word": false
2648
+ },
2649
+ {
2650
+ "content": "<|energetic|>",
2651
+ "lstrip": false,
2652
+ "normalized": false,
2653
+ "rstrip": false,
2654
+ "single_word": false
2655
+ },
2656
+ {
2657
+ "content": "<|sing|>",
2658
+ "lstrip": false,
2659
+ "normalized": false,
2660
+ "rstrip": false,
2661
+ "single_word": false
2662
+ },
2663
+ {
2664
+ "content": "<|/sing|>",
2665
+ "lstrip": false,
2666
+ "normalized": false,
2667
+ "rstrip": false,
2668
+ "single_word": false
2669
+ },
2670
+ {
2671
+ "content": "<|rap|>",
2672
+ "lstrip": false,
2673
+ "normalized": false,
2674
+ "rstrip": false,
2675
+ "single_word": false
2676
+ },
2677
+ {
2678
+ "content": "<|/rap|>",
2679
+ "lstrip": false,
2680
+ "normalized": false,
2681
+ "rstrip": false,
2682
+ "single_word": false
2683
+ },
2684
+ {
2685
+ "content": "<|chant|>",
2686
+ "lstrip": false,
2687
+ "normalized": false,
2688
+ "rstrip": false,
2689
+ "single_word": false
2690
+ },
2691
+ {
2692
+ "content": "<|/chant|>",
2693
+ "lstrip": false,
2694
+ "normalized": false,
2695
+ "rstrip": false,
2696
+ "single_word": false
2697
+ },
2698
+ {
2699
+ "content": "<|hum|>",
2700
+ "lstrip": false,
2701
+ "normalized": false,
2702
+ "rstrip": false,
2703
+ "single_word": false
2704
+ },
2705
+ {
2706
+ "content": "<|/hum|>",
2707
+ "lstrip": false,
2708
+ "normalized": false,
2709
+ "rstrip": false,
2710
+ "single_word": false
2711
+ },
2712
+ {
2713
+ "content": "<|whistle|>",
2714
+ "lstrip": false,
2715
+ "normalized": false,
2716
+ "rstrip": false,
2717
+ "single_word": false
2718
+ },
2719
+ {
2720
+ "content": "<|/whistle|>",
2721
+ "lstrip": false,
2722
+ "normalized": false,
2723
+ "rstrip": false,
2724
+ "single_word": false
2725
+ },
2726
+ {
2727
+ "content": "<|pitch|>",
2728
+ "lstrip": false,
2729
+ "normalized": false,
2730
+ "rstrip": false,
2731
+ "single_word": false
2732
+ },
2733
+ {
2734
+ "content": "<|/pitch|>",
2735
+ "lstrip": false,
2736
+ "normalized": false,
2737
+ "rstrip": false,
2738
+ "single_word": false
2739
+ },
2740
+ {
2741
+ "content": "<|tempo|>",
2742
+ "lstrip": false,
2743
+ "normalized": false,
2744
+ "rstrip": false,
2745
+ "single_word": false
2746
+ },
2747
+ {
2748
+ "content": "<|/tempo|>",
2749
+ "lstrip": false,
2750
+ "normalized": false,
2751
+ "rstrip": false,
2752
+ "single_word": false
2753
+ },
2754
+ {
2755
+ "content": "<|rhythm|>",
2756
+ "lstrip": false,
2757
+ "normalized": false,
2758
+ "rstrip": false,
2759
+ "single_word": false
2760
+ },
2761
+ {
2762
+ "content": "<|/rhythm|>",
2763
+ "lstrip": false,
2764
+ "normalized": false,
2765
+ "rstrip": false,
2766
+ "single_word": false
2767
+ },
2768
+ {
2769
+ "content": "<|melody|>",
2770
+ "lstrip": false,
2771
+ "normalized": false,
2772
+ "rstrip": false,
2773
+ "single_word": false
2774
+ },
2775
+ {
2776
+ "content": "<|/melody|>",
2777
+ "lstrip": false,
2778
+ "normalized": false,
2779
+ "rstrip": false,
2780
+ "single_word": false
2781
+ },
2782
+ {
2783
+ "content": "<|key|>",
2784
+ "lstrip": false,
2785
+ "normalized": false,
2786
+ "rstrip": false,
2787
+ "single_word": false
2788
+ },
2789
+ {
2790
+ "content": "<|/key|>",
2791
+ "lstrip": false,
2792
+ "normalized": false,
2793
+ "rstrip": false,
2794
+ "single_word": false
2795
+ },
2796
+ {
2797
+ "content": "<|style:pop|>",
2798
+ "lstrip": false,
2799
+ "normalized": false,
2800
+ "rstrip": false,
2801
+ "single_word": false
2802
+ },
2803
+ {
2804
+ "content": "<|style:rock|>",
2805
+ "lstrip": false,
2806
+ "normalized": false,
2807
+ "rstrip": false,
2808
+ "single_word": false
2809
+ },
2810
+ {
2811
+ "content": "<|style:jazz|>",
2812
+ "lstrip": false,
2813
+ "normalized": false,
2814
+ "rstrip": false,
2815
+ "single_word": false
2816
+ },
2817
+ {
2818
+ "content": "<|style:classical|>",
2819
+ "lstrip": false,
2820
+ "normalized": false,
2821
+ "rstrip": false,
2822
+ "single_word": false
2823
+ },
2824
+ {
2825
+ "content": "<|style:hiphop|>",
2826
+ "lstrip": false,
2827
+ "normalized": false,
2828
+ "rstrip": false,
2829
+ "single_word": false
2830
+ },
2831
+ {
2832
+ "content": "<|style:rnb|>",
2833
+ "lstrip": false,
2834
+ "normalized": false,
2835
+ "rstrip": false,
2836
+ "single_word": false
2837
+ },
2838
+ {
2839
+ "content": "<|style:country|>",
2840
+ "lstrip": false,
2841
+ "normalized": false,
2842
+ "rstrip": false,
2843
+ "single_word": false
2844
+ },
2845
+ {
2846
+ "content": "<|style:soul|>",
2847
+ "lstrip": false,
2848
+ "normalized": false,
2849
+ "rstrip": false,
2850
+ "single_word": false
2851
+ },
2852
+ {
2853
+ "content": "<|lyrics|>",
2854
+ "lstrip": false,
2855
+ "normalized": false,
2856
+ "rstrip": false,
2857
+ "single_word": false
2858
+ },
2859
+ {
2860
+ "content": "<|/lyrics|>",
2861
+ "lstrip": false,
2862
+ "normalized": false,
2863
+ "rstrip": false,
2864
+ "single_word": false
2865
+ },
2866
+ {
2867
+ "content": "<|verse|>",
2868
+ "lstrip": false,
2869
+ "normalized": false,
2870
+ "rstrip": false,
2871
+ "single_word": false
2872
+ },
2873
+ {
2874
+ "content": "<|/verse|>",
2875
+ "lstrip": false,
2876
+ "normalized": false,
2877
+ "rstrip": false,
2878
+ "single_word": false
2879
+ },
2880
+ {
2881
+ "content": "<|chorus|>",
2882
+ "lstrip": false,
2883
+ "normalized": false,
2884
+ "rstrip": false,
2885
+ "single_word": false
2886
+ },
2887
+ {
2888
+ "content": "<|/chorus|>",
2889
+ "lstrip": false,
2890
+ "normalized": false,
2891
+ "rstrip": false,
2892
+ "single_word": false
2893
+ },
2894
+ {
2895
+ "content": "<|bridge|>",
2896
+ "lstrip": false,
2897
+ "normalized": false,
2898
+ "rstrip": false,
2899
+ "single_word": false
2900
+ },
2901
+ {
2902
+ "content": "<|/bridge|>",
2903
+ "lstrip": false,
2904
+ "normalized": false,
2905
+ "rstrip": false,
2906
+ "single_word": false
2907
+ },
2908
+ {
2909
+ "content": "<|beatbox|>",
2910
+ "lstrip": false,
2911
+ "normalized": false,
2912
+ "rstrip": false,
2913
+ "single_word": false
2914
+ },
2915
+ {
2916
+ "content": "<|/beatbox|>",
2917
+ "lstrip": false,
2918
+ "normalized": false,
2919
+ "rstrip": false,
2920
+ "single_word": false
2921
+ },
2922
+ {
2923
+ "content": "<|perc|>",
2924
+ "lstrip": false,
2925
+ "normalized": false,
2926
+ "rstrip": false,
2927
+ "single_word": false
2928
+ },
2929
+ {
2930
+ "content": "<|/perc|>",
2931
+ "lstrip": false,
2932
+ "normalized": false,
2933
+ "rstrip": false,
2934
+ "single_word": false
2935
+ },
2936
+ {
2937
+ "content": "<|kick|>",
2938
+ "lstrip": false,
2939
+ "normalized": false,
2940
+ "rstrip": false,
2941
+ "single_word": false
2942
+ },
2943
+ {
2944
+ "content": "<|snare|>",
2945
+ "lstrip": false,
2946
+ "normalized": false,
2947
+ "rstrip": false,
2948
+ "single_word": false
2949
+ },
2950
+ {
2951
+ "content": "<|hihat|>",
2952
+ "lstrip": false,
2953
+ "normalized": false,
2954
+ "rstrip": false,
2955
+ "single_word": false
2956
+ },
2957
+ {
2958
+ "content": "<|crash|>",
2959
+ "lstrip": false,
2960
+ "normalized": false,
2961
+ "rstrip": false,
2962
+ "single_word": false
2963
+ },
2964
+ {
2965
+ "content": "<|fill|>",
2966
+ "lstrip": false,
2967
+ "normalized": false,
2968
+ "rstrip": false,
2969
+ "single_word": false
2970
+ },
2971
+ {
2972
+ "content": "<|click|>",
2973
+ "lstrip": false,
2974
+ "normalized": false,
2975
+ "rstrip": false,
2976
+ "single_word": false
2977
+ },
2978
+ {
2979
+ "content": "<|pop|>",
2980
+ "lstrip": false,
2981
+ "normalized": false,
2982
+ "rstrip": false,
2983
+ "single_word": false
2984
+ },
2985
+ {
2986
+ "content": "<|whisper|>",
2987
+ "lstrip": false,
2988
+ "normalized": false,
2989
+ "rstrip": false,
2990
+ "single_word": false
2991
+ },
2992
+ {
2993
+ "content": "<|/whisper|>",
2994
+ "lstrip": false,
2995
+ "normalized": false,
2996
+ "rstrip": false,
2997
+ "single_word": false
2998
+ },
2999
+ {
3000
+ "content": "<|shout|>",
3001
+ "lstrip": false,
3002
+ "normalized": false,
3003
+ "rstrip": false,
3004
+ "single_word": false
3005
+ },
3006
+ {
3007
+ "content": "<|/shout|>",
3008
+ "lstrip": false,
3009
+ "normalized": false,
3010
+ "rstrip": false,
3011
+ "single_word": false
3012
+ },
3013
+ {
3014
+ "content": "<|growl|>",
3015
+ "lstrip": false,
3016
+ "normalized": false,
3017
+ "rstrip": false,
3018
+ "single_word": false
3019
+ },
3020
+ {
3021
+ "content": "<|/growl|>",
3022
+ "lstrip": false,
3023
+ "normalized": false,
3024
+ "rstrip": false,
3025
+ "single_word": false
3026
+ },
3027
+ {
3028
+ "content": "<|falsetto|>",
3029
+ "lstrip": false,
3030
+ "normalized": false,
3031
+ "rstrip": false,
3032
+ "single_word": false
3033
+ },
3034
+ {
3035
+ "content": "<|/falsetto|>",
3036
+ "lstrip": false,
3037
+ "normalized": false,
3038
+ "rstrip": false,
3039
+ "single_word": false
3040
+ },
3041
+ {
3042
+ "content": "<|breath_in|>",
3043
+ "lstrip": false,
3044
+ "normalized": false,
3045
+ "rstrip": false,
3046
+ "single_word": false
3047
+ },
3048
+ {
3049
+ "content": "<|breath_out|>",
3050
+ "lstrip": false,
3051
+ "normalized": false,
3052
+ "rstrip": false,
3053
+ "single_word": false
3054
+ },
3055
+ {
3056
+ "content": "<|breath_heavy|>",
3057
+ "lstrip": false,
3058
+ "normalized": false,
3059
+ "rstrip": false,
3060
+ "single_word": false
3061
+ },
3062
+ {
3063
+ "content": "<|sigh_x|>",
3064
+ "lstrip": false,
3065
+ "normalized": false,
3066
+ "rstrip": false,
3067
+ "single_word": false
3068
+ },
3069
+ {
3070
+ "content": "<|gasp|>",
3071
+ "lstrip": false,
3072
+ "normalized": false,
3073
+ "rstrip": false,
3074
+ "single_word": false
3075
+ },
3076
+ {
3077
+ "content": "<|yawn|>",
3078
+ "lstrip": false,
3079
+ "normalized": false,
3080
+ "rstrip": false,
3081
+ "single_word": false
3082
+ },
3083
+ {
3084
+ "content": "<|ahem|>",
3085
+ "lstrip": false,
3086
+ "normalized": false,
3087
+ "rstrip": false,
3088
+ "single_word": false
3089
+ },
3090
+ {
3091
+ "content": "<|hmm|>",
3092
+ "lstrip": false,
3093
+ "normalized": false,
3094
+ "rstrip": false,
3095
+ "single_word": false
3096
+ },
3097
+ {
3098
+ "content": "<|aha|>",
3099
+ "lstrip": false,
3100
+ "normalized": false,
3101
+ "rstrip": false,
3102
+ "single_word": false
3103
+ },
3104
+ {
3105
+ "content": "<|ooh|>",
3106
+ "lstrip": false,
3107
+ "normalized": false,
3108
+ "rstrip": false,
3109
+ "single_word": false
3110
+ },
3111
+ {
3112
+ "content": "<|wow|>",
3113
+ "lstrip": false,
3114
+ "normalized": false,
3115
+ "rstrip": false,
3116
+ "single_word": false
3117
+ },
3118
+ {
3119
+ "content": "<|ugh|>",
3120
+ "lstrip": false,
3121
+ "normalized": false,
3122
+ "rstrip": false,
3123
+ "single_word": false
3124
+ },
3125
+ {
3126
+ "content": "<|phew|>",
3127
+ "lstrip": false,
3128
+ "normalized": false,
3129
+ "rstrip": false,
3130
+ "single_word": false
3131
+ },
3132
+ {
3133
+ "content": "<|tsk|>",
3134
+ "lstrip": false,
3135
+ "normalized": false,
3136
+ "rstrip": false,
3137
+ "single_word": false
3138
+ },
3139
+ {
3140
+ "content": "<|shh|>",
3141
+ "lstrip": false,
3142
+ "normalized": false,
3143
+ "rstrip": false,
3144
+ "single_word": false
3145
+ },
3146
+ {
3147
+ "content": "<|adlib|>",
3148
+ "lstrip": false,
3149
+ "normalized": false,
3150
+ "rstrip": false,
3151
+ "single_word": false
3152
+ },
3153
+ {
3154
+ "content": "<|/adlib|>",
3155
+ "lstrip": false,
3156
+ "normalized": false,
3157
+ "rstrip": false,
3158
+ "single_word": false
3159
+ },
3160
+ {
3161
+ "content": "<|harmony|>",
3162
+ "lstrip": false,
3163
+ "normalized": false,
3164
+ "rstrip": false,
3165
+ "single_word": false
3166
+ },
3167
+ {
3168
+ "content": "<|/harmony|>",
3169
+ "lstrip": false,
3170
+ "normalized": false,
3171
+ "rstrip": false,
3172
+ "single_word": false
3173
+ },
3174
+ {
3175
+ "content": "<|poly|>",
3176
+ "lstrip": false,
3177
+ "normalized": false,
3178
+ "rstrip": false,
3179
+ "single_word": false
3180
+ },
3181
+ {
3182
+ "content": "<|/poly|>",
3183
+ "lstrip": false,
3184
+ "normalized": false,
3185
+ "rstrip": false,
3186
+ "single_word": false
3187
+ },
3188
+ {
3189
+ "content": "<|vibrato|>",
3190
+ "lstrip": false,
3191
+ "normalized": false,
3192
+ "rstrip": false,
3193
+ "single_word": false
3194
+ },
3195
+ {
3196
+ "content": "<|tremolo|>",
3197
+ "lstrip": false,
3198
+ "normalized": false,
3199
+ "rstrip": false,
3200
+ "single_word": false
3201
+ },
3202
+ {
3203
+ "content": "<|gliss|>",
3204
+ "lstrip": false,
3205
+ "normalized": false,
3206
+ "rstrip": false,
3207
+ "single_word": false
3208
+ },
3209
+ {
3210
+ "content": "<|spec|>",
3211
+ "lstrip": false,
3212
+ "normalized": false,
3213
+ "rstrip": false,
3214
+ "single_word": false
3215
+ },
3216
+ {
3217
+ "content": "<|/spec|>",
3218
+ "lstrip": false,
3219
+ "normalized": false,
3220
+ "rstrip": false,
3221
+ "single_word": false
3222
+ },
3223
+ {
3224
+ "content": "<|spec_ok|>",
3225
+ "lstrip": false,
3226
+ "normalized": false,
3227
+ "rstrip": false,
3228
+ "single_word": false
3229
+ },
3230
+ {
3231
+ "content": "<|spec_no|>",
3232
+ "lstrip": false,
3233
+ "normalized": false,
3234
+ "rstrip": false,
3235
+ "single_word": false
3236
+ },
3237
+ {
3238
+ "content": "<|rewrite|>",
3239
+ "lstrip": false,
3240
+ "normalized": false,
3241
+ "rstrip": false,
3242
+ "single_word": false
3243
+ },
3244
+ {
3245
+ "content": "<|/rewrite|>",
3246
+ "lstrip": false,
3247
+ "normalized": false,
3248
+ "rstrip": false,
3249
+ "single_word": false
3250
+ },
3251
+ {
3252
+ "content": "<|rollback|>",
3253
+ "lstrip": false,
3254
+ "normalized": false,
3255
+ "rstrip": false,
3256
+ "single_word": false
3257
+ },
3258
+ {
3259
+ "content": "<|checkpoint|>",
3260
+ "lstrip": false,
3261
+ "normalized": false,
3262
+ "rstrip": false,
3263
+ "single_word": false
3264
+ },
3265
+ {
3266
+ "content": "<|conf_tok|>",
3267
+ "lstrip": false,
3268
+ "normalized": false,
3269
+ "rstrip": false,
3270
+ "single_word": false
3271
+ },
3272
+ {
3273
+ "content": "<|unc_tok|>",
3274
+ "lstrip": false,
3275
+ "normalized": false,
3276
+ "rstrip": false,
3277
+ "single_word": false
3278
+ },
3279
+ {
3280
+ "content": "<|draft|>",
3281
+ "lstrip": false,
3282
+ "normalized": false,
3283
+ "rstrip": false,
3284
+ "single_word": false
3285
+ },
3286
+ {
3287
+ "content": "<|/draft|>",
3288
+ "lstrip": false,
3289
+ "normalized": false,
3290
+ "rstrip": false,
3291
+ "single_word": false
3292
+ },
3293
+ {
3294
+ "content": "<|final|>",
3295
+ "lstrip": false,
3296
+ "normalized": false,
3297
+ "rstrip": false,
3298
+ "single_word": false
3299
+ },
3300
+ {
3301
+ "content": "<|/final|>",
3302
+ "lstrip": false,
3303
+ "normalized": false,
3304
+ "rstrip": false,
3305
+ "single_word": false
3306
+ },
3307
+ {
3308
+ "content": "<|table|>",
3309
+ "lstrip": false,
3310
+ "normalized": false,
3311
+ "rstrip": false,
3312
+ "single_word": false
3313
+ },
3314
+ {
3315
+ "content": "<|/table|>",
3316
+ "lstrip": false,
3317
+ "normalized": false,
3318
+ "rstrip": false,
3319
+ "single_word": false
3320
+ },
3321
+ {
3322
+ "content": "<|row|>",
3323
+ "lstrip": false,
3324
+ "normalized": false,
3325
+ "rstrip": false,
3326
+ "single_word": false
3327
+ },
3328
+ {
3329
+ "content": "<|/row|>",
3330
+ "lstrip": false,
3331
+ "normalized": false,
3332
+ "rstrip": false,
3333
+ "single_word": false
3334
+ },
3335
+ {
3336
+ "content": "<|cell|>",
3337
+ "lstrip": false,
3338
+ "normalized": false,
3339
+ "rstrip": false,
3340
+ "single_word": false
3341
+ },
3342
+ {
3343
+ "content": "<|/cell|>",
3344
+ "lstrip": false,
3345
+ "normalized": false,
3346
+ "rstrip": false,
3347
+ "single_word": false
3348
+ },
3349
+ {
3350
+ "content": "<|thead|>",
3351
+ "lstrip": false,
3352
+ "normalized": false,
3353
+ "rstrip": false,
3354
+ "single_word": false
3355
+ },
3356
+ {
3357
+ "content": "<|/thead|>",
3358
+ "lstrip": false,
3359
+ "normalized": false,
3360
+ "rstrip": false,
3361
+ "single_word": false
3362
+ },
3363
+ {
3364
+ "content": "<|tbody|>",
3365
+ "lstrip": false,
3366
+ "normalized": false,
3367
+ "rstrip": false,
3368
+ "single_word": false
3369
+ },
3370
+ {
3371
+ "content": "<|/tbody|>",
3372
+ "lstrip": false,
3373
+ "normalized": false,
3374
+ "rstrip": false,
3375
+ "single_word": false
3376
+ },
3377
+ {
3378
+ "content": "<|schema|>",
3379
+ "lstrip": false,
3380
+ "normalized": false,
3381
+ "rstrip": false,
3382
+ "single_word": false
3383
+ },
3384
+ {
3385
+ "content": "<|/schema|>",
3386
+ "lstrip": false,
3387
+ "normalized": false,
3388
+ "rstrip": false,
3389
+ "single_word": false
3390
+ },
3391
+ {
3392
+ "content": "<|field|>",
3393
+ "lstrip": false,
3394
+ "normalized": false,
3395
+ "rstrip": false,
3396
+ "single_word": false
3397
+ },
3398
+ {
3399
+ "content": "<|/field|>",
3400
+ "lstrip": false,
3401
+ "normalized": false,
3402
+ "rstrip": false,
3403
+ "single_word": false
3404
+ },
3405
+ {
3406
+ "content": "<|type|>",
3407
+ "lstrip": false,
3408
+ "normalized": false,
3409
+ "rstrip": false,
3410
+ "single_word": false
3411
+ },
3412
+ {
3413
+ "content": "<|/type|>",
3414
+ "lstrip": false,
3415
+ "normalized": false,
3416
+ "rstrip": false,
3417
+ "single_word": false
3418
+ },
3419
+ {
3420
+ "content": "<|required|>",
3421
+ "lstrip": false,
3422
+ "normalized": false,
3423
+ "rstrip": false,
3424
+ "single_word": false
3425
+ },
3426
+ {
3427
+ "content": "<|optional|>",
3428
+ "lstrip": false,
3429
+ "normalized": false,
3430
+ "rstrip": false,
3431
+ "single_word": false
3432
+ },
3433
+ {
3434
+ "content": "<|version|>",
3435
+ "lstrip": false,
3436
+ "normalized": false,
3437
+ "rstrip": false,
3438
+ "single_word": false
3439
+ },
3440
+ {
3441
+ "content": "<|/version|>",
3442
+ "lstrip": false,
3443
+ "normalized": false,
3444
+ "rstrip": false,
3445
+ "single_word": false
3446
+ },
3447
+ {
3448
+ "content": "<|deprecated|>",
3449
+ "lstrip": false,
3450
+ "normalized": false,
3451
+ "rstrip": false,
3452
+ "single_word": false
3453
+ },
3454
+ {
3455
+ "content": "<|since|>",
3456
+ "lstrip": false,
3457
+ "normalized": false,
3458
+ "rstrip": false,
3459
+ "single_word": false
3460
+ },
3461
+ {
3462
+ "content": "<|/since|>",
3463
+ "lstrip": false,
3464
+ "normalized": false,
3465
+ "rstrip": false,
3466
+ "single_word": false
3467
+ },
3468
+ {
3469
+ "content": "<|changelog|>",
3470
+ "lstrip": false,
3471
+ "normalized": false,
3472
+ "rstrip": false,
3473
+ "single_word": false
3474
+ },
3475
+ {
3476
+ "content": "<|/changelog|>",
3477
+ "lstrip": false,
3478
+ "normalized": false,
3479
+ "rstrip": false,
3480
+ "single_word": false
3481
+ },
3482
+ {
3483
+ "content": "<|json|>",
3484
+ "lstrip": false,
3485
+ "normalized": false,
3486
+ "rstrip": false,
3487
+ "single_word": false
3488
+ },
3489
+ {
3490
+ "content": "<|/json|>",
3491
+ "lstrip": false,
3492
+ "normalized": false,
3493
+ "rstrip": false,
3494
+ "single_word": false
3495
+ },
3496
+ {
3497
+ "content": "<|xml|>",
3498
+ "lstrip": false,
3499
+ "normalized": false,
3500
+ "rstrip": false,
3501
+ "single_word": false
3502
+ },
3503
+ {
3504
+ "content": "<|/xml|>",
3505
+ "lstrip": false,
3506
+ "normalized": false,
3507
+ "rstrip": false,
3508
+ "single_word": false
3509
+ },
3510
+ {
3511
+ "content": "<|yaml|>",
3512
+ "lstrip": false,
3513
+ "normalized": false,
3514
+ "rstrip": false,
3515
+ "single_word": false
3516
+ },
3517
+ {
3518
+ "content": "<|/yaml|>",
3519
+ "lstrip": false,
3520
+ "normalized": false,
3521
+ "rstrip": false,
3522
+ "single_word": false
3523
+ },
3524
+ {
3525
+ "content": "<|csv|>",
3526
+ "lstrip": false,
3527
+ "normalized": false,
3528
+ "rstrip": false,
3529
+ "single_word": false
3530
+ },
3531
+ {
3532
+ "content": "<|/csv|>",
3533
+ "lstrip": false,
3534
+ "normalized": false,
3535
+ "rstrip": false,
3536
+ "single_word": false
3537
+ },
3538
+ {
3539
+ "content": "<|list|>",
3540
+ "lstrip": false,
3541
+ "normalized": false,
3542
+ "rstrip": false,
3543
+ "single_word": false
3544
+ },
3545
+ {
3546
+ "content": "<|/list|>",
3547
+ "lstrip": false,
3548
+ "normalized": false,
3549
+ "rstrip": false,
3550
+ "single_word": false
3551
+ },
3552
+ {
3553
+ "content": "<|item|>",
3554
+ "lstrip": false,
3555
+ "normalized": false,
3556
+ "rstrip": false,
3557
+ "single_word": false
3558
+ },
3559
+ {
3560
+ "content": "<|/item|>",
3561
+ "lstrip": false,
3562
+ "normalized": false,
3563
+ "rstrip": false,
3564
+ "single_word": false
3565
+ },
3566
+ {
3567
+ "content": "<|ol|>",
3568
+ "lstrip": false,
3569
+ "normalized": false,
3570
+ "rstrip": false,
3571
+ "single_word": false
3572
+ },
3573
+ {
3574
+ "content": "<|/ol|>",
3575
+ "lstrip": false,
3576
+ "normalized": false,
3577
+ "rstrip": false,
3578
+ "single_word": false
3579
+ },
3580
+ {
3581
+ "content": "<|ul|>",
3582
+ "lstrip": false,
3583
+ "normalized": false,
3584
+ "rstrip": false,
3585
+ "single_word": false
3586
+ },
3587
+ {
3588
+ "content": "<|/ul|>",
3589
+ "lstrip": false,
3590
+ "normalized": false,
3591
+ "rstrip": false,
3592
+ "single_word": false
3593
+ },
3594
+ {
3595
+ "content": "<|kv|>",
3596
+ "lstrip": false,
3597
+ "normalized": false,
3598
+ "rstrip": false,
3599
+ "single_word": false
3600
+ },
3601
+ {
3602
+ "content": "<|/kv|>",
3603
+ "lstrip": false,
3604
+ "normalized": false,
3605
+ "rstrip": false,
3606
+ "single_word": false
3607
+ },
3608
+ {
3609
+ "content": "<|key|>",
3610
+ "lstrip": false,
3611
+ "normalized": false,
3612
+ "rstrip": false,
3613
+ "single_word": false
3614
+ },
3615
+ {
3616
+ "content": "<|/key|>",
3617
+ "lstrip": false,
3618
+ "normalized": false,
3619
+ "rstrip": false,
3620
+ "single_word": false
3621
+ },
3622
+ {
3623
+ "content": "<|value|>",
3624
+ "lstrip": false,
3625
+ "normalized": false,
3626
+ "rstrip": false,
3627
+ "single_word": false
3628
+ },
3629
+ {
3630
+ "content": "<|/value|>",
3631
+ "lstrip": false,
3632
+ "normalized": false,
3633
+ "rstrip": false,
3634
+ "single_word": false
3635
+ },
3636
+ {
3637
+ "content": "<|task|>",
3638
+ "lstrip": false,
3639
+ "normalized": false,
3640
+ "rstrip": false,
3641
+ "single_word": false
3642
+ },
3643
+ {
3644
+ "content": "<|/task|>",
3645
+ "lstrip": false,
3646
+ "normalized": false,
3647
+ "rstrip": false,
3648
+ "single_word": false
3649
+ },
3650
+ {
3651
+ "content": "<|task_type|>",
3652
+ "lstrip": false,
3653
+ "normalized": false,
3654
+ "rstrip": false,
3655
+ "single_word": false
3656
+ },
3657
+ {
3658
+ "content": "<|/task_type|>",
3659
+ "lstrip": false,
3660
+ "normalized": false,
3661
+ "rstrip": false,
3662
+ "single_word": false
3663
+ },
3664
+ {
3665
+ "content": "<|instruction|>",
3666
+ "lstrip": false,
3667
+ "normalized": false,
3668
+ "rstrip": false,
3669
+ "single_word": false
3670
+ },
3671
+ {
3672
+ "content": "<|/instruction|>",
3673
+ "lstrip": false,
3674
+ "normalized": false,
3675
+ "rstrip": false,
3676
+ "single_word": false
3677
+ },
3678
+ {
3679
+ "content": "<|constraint|>",
3680
+ "lstrip": false,
3681
+ "normalized": false,
3682
+ "rstrip": false,
3683
+ "single_word": false
3684
+ },
3685
+ {
3686
+ "content": "<|/constraint|>",
3687
+ "lstrip": false,
3688
+ "normalized": false,
3689
+ "rstrip": false,
3690
+ "single_word": false
3691
+ },
3692
+ {
3693
+ "content": "<|example|>",
3694
+ "lstrip": false,
3695
+ "normalized": false,
3696
+ "rstrip": false,
3697
+ "single_word": false
3698
+ },
3699
+ {
3700
+ "content": "<|/example|>",
3701
+ "lstrip": false,
3702
+ "normalized": false,
3703
+ "rstrip": false,
3704
+ "single_word": false
3705
+ },
3706
+ {
3707
+ "content": "<|input|>",
3708
+ "lstrip": false,
3709
+ "normalized": false,
3710
+ "rstrip": false,
3711
+ "single_word": false
3712
+ },
3713
+ {
3714
+ "content": "<|/input|>",
3715
+ "lstrip": false,
3716
+ "normalized": false,
3717
+ "rstrip": false,
3718
+ "single_word": false
3719
+ },
3720
+ {
3721
+ "content": "<|output|>",
3722
+ "lstrip": false,
3723
+ "normalized": false,
3724
+ "rstrip": false,
3725
+ "single_word": false
3726
+ },
3727
+ {
3728
+ "content": "<|/output|>",
3729
+ "lstrip": false,
3730
+ "normalized": false,
3731
+ "rstrip": false,
3732
+ "single_word": false
3733
+ },
3734
+ {
3735
+ "content": "<|expected|>",
3736
+ "lstrip": false,
3737
+ "normalized": false,
3738
+ "rstrip": false,
3739
+ "single_word": false
3740
+ },
3741
+ {
3742
+ "content": "<|/expected|>",
3743
+ "lstrip": false,
3744
+ "normalized": false,
3745
+ "rstrip": false,
3746
+ "single_word": false
3747
+ },
3748
+ {
3749
+ "content": "<|sep|>",
3750
+ "lstrip": false,
3751
+ "normalized": false,
3752
+ "rstrip": false,
3753
+ "single_word": false
3754
+ },
3755
+ {
3756
+ "content": "<|nl|>",
3757
+ "lstrip": false,
3758
+ "normalized": false,
3759
+ "rstrip": false,
3760
+ "single_word": false
3761
+ },
3762
+ {
3763
+ "content": "<|mask|>",
3764
+ "lstrip": false,
3765
+ "normalized": false,
3766
+ "rstrip": false,
3767
+ "single_word": false
3768
+ },
3769
+ {
3770
+ "content": "<|...|>",
3771
+ "lstrip": false,
3772
+ "normalized": false,
3773
+ "rstrip": false,
3774
+ "single_word": false
3775
+ },
3776
+ {
3777
+ "content": "<|cont|>",
3778
+ "lstrip": false,
3779
+ "normalized": false,
3780
+ "rstrip": false,
3781
+ "single_word": false
3782
+ },
3783
+ {
3784
+ "content": "<|truncated|>",
3785
+ "lstrip": false,
3786
+ "normalized": false,
3787
+ "rstrip": false,
3788
+ "single_word": false
3789
+ },
3790
+ {
3791
+ "content": "<|redacted|>",
3792
+ "lstrip": false,
3793
+ "normalized": false,
3794
+ "rstrip": false,
3795
+ "single_word": false
3796
+ }
3797
+ ],
3798
+ "bos_token": "<|bos|>",
3799
+ "eos_token": "<|eos|>",
3800
+ "pad_token": "<|pad|>"
3801
+ }
streaming_state.json ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 1,
3
+ "unique_samples": 600,
4
+ "total_yields": 1200,
5
+ "dataset_positions": {
6
+ "T2V-Sora-Preferences-2": 50,
7
+ "Sora-Physics-Likert": 50,
8
+ "Sora-Style-Likert": 50,
9
+ "Sora-Alignment-Likert": 50,
10
+ "WebVid-10M": 50,
11
+ "T2V-Human-Preferences": 50,
12
+ "TIP-I2V": 50,
13
+ "I2V-Preference-Seedance": 50,
14
+ "Pexels-I2V-350k": 50
15
+ },
16
+ "modality_positions": {
17
+ "text": {},
18
+ "image": {},
19
+ "video": {
20
+ "T2V-Sora-Preferences-2": 50,
21
+ "Sora-Physics-Likert": 50,
22
+ "Sora-Style-Likert": 50,
23
+ "Sora-Alignment-Likert": 50,
24
+ "WebVid-10M": 50,
25
+ "T2V-Human-Preferences": 50,
26
+ "TIP-I2V": 50,
27
+ "I2V-Preference-Seedance": 50,
28
+ "Pexels-I2V-350k": 50
29
+ },
30
+ "audio": {}
31
+ },
32
+ "modality_counts": {
33
+ "text": 0,
34
+ "image": 0,
35
+ "video": 600,
36
+ "audio": 0
37
+ },
38
+ "last_modality": null
39
+ }
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa9c470e506980aeb8552c4c6fc87fe50a19637fc1bfd0ab77a8422f26a8f89f
3
- size 11498197
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d27d705d6b96a348ab0adece83feb6480983d947f7be700666328942f89381b5
3
+ size 11523225
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff
 
trainer_state.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_model_checkpoint": "/kaggle/working/xoron-final",
3
+ "best_metric": 5.7690568415215235,
4
+ "epoch": 1,
5
+ "epochs_completed": 1,
6
+ "global_step": 75,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [],
10
+ "logging_steps": 50,
11
+ "max_steps": 75,
12
+ "num_train_epochs": 1,
13
+ "total_flos": 0,
14
+ "train_batch_size": 1,
15
+ "effective_batch_size": 16,
16
+ "learning_rate": 0.0001,
17
+ "max_grad_norm": 1.0,
18
+ "trainable_components": [
19
+ "vision",
20
+ "video",
21
+ "llm",
22
+ "cross_attention",
23
+ "video_generation",
24
+ "modality_markers"
25
+ ],
26
+ "frozen_components": [
27
+ "audio",
28
+ "speech",
29
+ "image_generation"
30
+ ],
31
+ "trial_name": null,
32
+ "trial_params": null
33
+ }
training_state.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:647593a02fec5fd433976f9437423cf476ebbde58661768128bb3a260d7df19c
3
+ size 781492737
video_encoder.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:daa3a72612cd56cbc02329ce601ff15c55a6050ae2384d1db4e58563879a12b1
3
- size 3402793248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c948b6061b0ecb4072916f2235ae4f82e70de6afaec7c92e062eab816f39d009
3
+ size 1701439560
video_generator.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5506b7b8cb74bd363d8618dd7524c28f8a0b8940763f8ea0cda93d0d8e1d8f14
3
- size 94479052
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0247a6cd33b7379b130129a2fd83fa1277367cc63057bd6f78996139e1a8a74
3
+ size 47250054
vision_encoder.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:97c435b54f83027950ff705c34e0e8d6e76cd6f6a23c51813c4151e6e02d2c20
3
- size 2001005664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ec8ec4f98fc89e96a37bb96634ca6de303cc7ebadb0d4e706e3727f947ecd15
3
+ size 1000535480
vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
waveform_decoder.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6d443fbe40c31e005a96f24ddda0da05ea1552807c0426e2cdc0d0d54f72f50f
3
- size 69328680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42452429ed067aab616714ccfc0b1304166da6c21a8e7d8265815451701b6ed4
3
+ size 34681076