AEmotionStudio commited on
Commit
63a7ec7
·
verified ·
1 Parent(s): 06a1832

Mirror OpenMOSS-Team/MOSS-TTS-Local-Transformer-v1.5 @ be7766a6735b + OpenMOSS-Team/MOSS-Audio-Tokenizer-v2 @ f6e20e543b33 for MAESTRO (local_v15/)

Browse files

- model/: safetensors + tokenizer/config files VERBATIM (sha256 vs upstream LFS)
- codec/: re-sharded by top-level module (encoder / decoder / quantizer); provenance in codec/sha256.json
- HF remote-code .py files dropped: MAESTRO vendors the GitHub graphs (ai/moss_tts_vendor), never trust_remote_code

Loaded by MAESTRO via backend/ai/models/moss_tts.py (codec halves sequenced on/off the GPU).

.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ local_v15/model/tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,127 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ - zh
6
+ - yue
7
+ - ja
8
+ - ko
9
+ - fr
10
+ - de
11
+ - es
12
+ - it
13
+ - pt
14
+ - ru
15
+ - ar
16
+ - hi
17
+ - nl
18
+ - pl
19
+ - tr
20
+ - vi
21
+ - th
22
+ - sv
23
+ - da
24
+ - fi
25
+ - cs
26
+ - el
27
+ - he
28
+ - hu
29
+ - ro
30
+ - ms
31
+ - fa
32
+ - sw
33
+ - tl
34
+ - mk
35
+ pipeline_tag: text-to-speech
36
+ tags:
37
+ - text-to-speech
38
+ - voice-cloning
39
+ - moss-tts-family
40
+ - maestro
41
+ base_model:
42
+ - OpenMOSS-Team/MOSS-TTS-Local-Transformer-v1.5
43
+ - OpenMOSS-Team/MOSS-Audio-Tokenizer-v2
44
+ - OpenMOSS-Team/MOSS-TTS-v1.5
45
+ - OpenMOSS-Team/MOSS-Audio-Tokenizer
46
+ ---
47
+
48
+ # MOSS-TTS v1.5 family — MAESTRO mirror
49
+
50
+ Redistribution of the OpenMOSS **MOSS-TTS v1.5** checkpoints and their codecs,
51
+ packaged for the [MAESTRO](https://github.com/AEmotionStudio) audio
52
+ workstation's offline runtime. All credit to the OpenMOSS team (Fudan
53
+ University) — code and weights are **Apache-2.0**
54
+ ([MOSS-TTS](https://github.com/OpenMOSS/MOSS-TTS),
55
+ [MOSS-Audio-Tokenizer](https://github.com/OpenMOSS/MOSS-Audio-Tokenizer)).
56
+
57
+ MOSS-TTS v1.5 is zero-shot voice-cloning text-to-speech in **31 languages**:
58
+ clone a speaker from a few seconds of reference audio (no transcript) or use
59
+ the model's own voice, with explicit language tags, inline `[pause X.Ys]`
60
+ marks and token-level duration control.
61
+
62
+ | lane | upstream | revision | what |
63
+ |---|---|---|---|
64
+ | `local_v15/` | [MOSS-TTS-Local-Transformer-v1.5](https://huggingface.co/OpenMOSS-Team/MOSS-TTS-Local-Transformer-v1.5) | `be7766a6735b98bd793f7c79fb720b4d0f5d13b8` | 4B MossTTSLocal — Qwen3-4B backbone + a 1-layer local transformer over 12 RVQ codebooks |
65
+ | `local_v15/codec/` | [MOSS-Audio-Tokenizer-v2](https://huggingface.co/OpenMOSS-Team/MOSS-Audio-Tokenizer-v2) | `f6e20e543b33d2c252a7ef71bdf8aa71e5ff9169` | native **48 kHz stereo**, 12.5 Hz, 2B params |
66
+ | `delay_v15/` | [MOSS-TTS-v1.5](https://huggingface.co/OpenMOSS-Team/MOSS-TTS-v1.5) | `cdd3b911b1585e3f2dbc7775ef10f9926f58850a` | 8B MossTTSDelay — Qwen3-8B backbone + delay-pattern heads over 32 RVQ codebooks |
67
+ | `delay_v15/codec/` | [MOSS-Audio-Tokenizer](https://huggingface.co/OpenMOSS-Team/MOSS-Audio-Tokenizer) | `3cd226ba2947efa357ef453bcad111b6eafba782` | 24 kHz mono, 12.5 Hz, 1.77B params |
68
+
69
+ ## Layout
70
+
71
+ ```
72
+ local_v15/model/ config.json, model.safetensors (bf16, 9.10 GB — VERBATIM upstream),
73
+ tokenizer + config files
74
+ local_v15/codec/ config.json (upstream + the shipped codec_weight_dtype)
75
+ encoder.safetensors — encoder.* tensors
76
+ decoder.safetensors — decoder.* tensors
77
+ quantizer.safetensors — quantizer.* tensors (always fp32)
78
+ model.safetensors.index.json — maps every tensor → the three files
79
+ sha256.json — upstream shard hashes + per-tensor provenance
80
+ delay_v15/model/ config.json, model-0000N-of-00004.safetensors (bf16, 17.0 GB — VERBATIM),
81
+ model.safetensors.index.json, tokenizer + config files
82
+ delay_v15/codec/ config.json, decoder.safetensors (decoder.* + quantizer.*, fp32),
83
+ encoder.safetensors (encoder.*, fp32), model.safetensors.index.json,
84
+ sha256.json — byte-identical to upstream (per-tensor sha256 proof)
85
+ ```
86
+
87
+ ### Why the codecs are re-sharded
88
+
89
+ Voice cloning **encodes** the reference clip once and **decodes** the take
90
+ once — never both at the same time. The codecs are re-partitioned **by
91
+ top-level module** so MAESTRO can materialise one half at a time and move it
92
+ on and off the GPU around its single call; on a 12 GB card that is the
93
+ difference between the 4B language model fitting and not. Each lane's
94
+ `codec/sha256.json` carries the upstream shard hashes and a per-tensor sha256
95
+ so the split is verifiable: the v1 codec and the v2 quantizer are byte-identical
96
+ to upstream; if `local_v15/codec/config.json` says `codec_weight_dtype: bf16`,
97
+ the v2 encoder/decoder halves were cast fp32 → bf16 (upstream's own default
98
+ `codec_weight_dtype` for this model) and both the upstream and the shipped
99
+ digest are recorded.
100
+
101
+ ### What was dropped
102
+
103
+ The upstream repos' remote-code `.py` files. MAESTRO vendors the GitHub
104
+ `moss_tts_local_v1.5/` and `moss_tts_delay/` graphs and both codec
105
+ implementations (patched for transformers 4.57.x) and never uses
106
+ `trust_remote_code`. The upstream READMEs are replaced by this card.
107
+
108
+ ## Loading
109
+
110
+ With the upstream code (the model repos carry it):
111
+
112
+ ```python
113
+ from transformers import AutoModel, AutoProcessor
114
+ processor = AutoProcessor.from_pretrained("OpenMOSS-Team/MOSS-TTS-Local-Transformer-v1.5",
115
+ trust_remote_code=True)
116
+ model = AutoModel.from_pretrained("AEmotionStudio/moss-tts-models", subfolder="local_v15/model",
117
+ trust_remote_code=True, torch_dtype="bfloat16")
118
+ ```
119
+
120
+ Inside MAESTRO: `backend/ai/models/moss_tts.py` (one runner, both lanes;
121
+ codec halves via `ai/moss_tts_vendor/audio_tokenizer_v2/loading.py` and
122
+ `ai/moss_tts_vendor/audio_tokenizer/loading.py`).
123
+
124
+ ## License
125
+
126
+ Apache License 2.0 — © OpenMOSS / Fudan University. This mirror adds no
127
+ restrictions and claims no ownership. Please cite the upstream projects.
local_v15/codec/config.json ADDED
@@ -0,0 +1,416 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "MossAudioTokenizerModel"
4
+ ],
5
+ "auto_map": {
6
+ "AutoConfig": "configuration_moss_audio_tokenizer.MossAudioTokenizerConfig",
7
+ "AutoModel": "modeling_moss_audio_tokenizer.MossAudioTokenizerModel"
8
+ },
9
+ "model_type": "moss-audio-tokenizer",
10
+ "sample_rate": 48000,
11
+ "sampling_rate": 48000,
12
+ "downsample_rate": 3840,
13
+ "causal_transformer_context_duration": 10.0,
14
+ "number_channels": 2,
15
+ "enable_channel_interleave": true,
16
+ "attention_implementation": "flash_attention_2",
17
+ "compute_dtype": "bf16",
18
+ "dtype": "float32",
19
+ "code_dim": 768,
20
+ "encoder_kwargs": [
21
+ {
22
+ "module_type": "PatchedPretransform",
23
+ "patch_size": 240
24
+ },
25
+ {
26
+ "module_type": "Transformer",
27
+ "input_dimension": 240,
28
+ "output_dimension": 384,
29
+ "d_model": 768,
30
+ "num_heads": 12,
31
+ "num_layers": 12,
32
+ "dim_feedforward": 3072,
33
+ "causal": true,
34
+ "norm": "layer_norm",
35
+ "positional_embedding": "rope",
36
+ "max_period": 10000,
37
+ "gating": "none",
38
+ "layer_scale": 0.01,
39
+ "conv_layout": true,
40
+ "context_duration": 1.0
41
+ },
42
+ {
43
+ "module_type": "PatchedPretransform",
44
+ "patch_size": 2
45
+ },
46
+ {
47
+ "module_type": "Transformer",
48
+ "input_dimension": 768,
49
+ "output_dimension": 384,
50
+ "d_model": 768,
51
+ "num_heads": 12,
52
+ "num_layers": 12,
53
+ "dim_feedforward": 3072,
54
+ "causal": true,
55
+ "norm": "layer_norm",
56
+ "positional_embedding": "rope",
57
+ "max_period": 10000,
58
+ "gating": "none",
59
+ "layer_scale": 0.01,
60
+ "conv_layout": true,
61
+ "context_duration": 2.0
62
+ },
63
+ {
64
+ "module_type": "PatchedPretransform",
65
+ "patch_size": 2
66
+ },
67
+ {
68
+ "module_type": "Transformer",
69
+ "input_dimension": 768,
70
+ "output_dimension": 384,
71
+ "d_model": 768,
72
+ "num_heads": 12,
73
+ "num_layers": 12,
74
+ "dim_feedforward": 3072,
75
+ "causal": true,
76
+ "norm": "layer_norm",
77
+ "positional_embedding": "rope",
78
+ "max_period": 10000,
79
+ "gating": "none",
80
+ "layer_scale": 0.01,
81
+ "conv_layout": true,
82
+ "context_duration": 4.0
83
+ },
84
+ {
85
+ "module_type": "PatchedPretransform",
86
+ "patch_size": 2
87
+ },
88
+ {
89
+ "module_type": "Transformer",
90
+ "input_dimension": 768,
91
+ "output_dimension": 384,
92
+ "d_model": 768,
93
+ "num_heads": 12,
94
+ "num_layers": 12,
95
+ "dim_feedforward": 3072,
96
+ "causal": true,
97
+ "norm": "layer_norm",
98
+ "positional_embedding": "rope",
99
+ "max_period": 10000,
100
+ "gating": "none",
101
+ "layer_scale": 0.01,
102
+ "conv_layout": true,
103
+ "context_duration": 8.0
104
+ },
105
+ {
106
+ "module_type": "PatchedPretransform",
107
+ "patch_size": 2
108
+ },
109
+ {
110
+ "module_type": "Transformer",
111
+ "input_dimension": 768,
112
+ "output_dimension": 640,
113
+ "d_model": 768,
114
+ "num_heads": 12,
115
+ "num_layers": 12,
116
+ "dim_feedforward": 3072,
117
+ "causal": true,
118
+ "norm": "layer_norm",
119
+ "positional_embedding": "rope",
120
+ "max_period": 10000,
121
+ "gating": "none",
122
+ "layer_scale": 0.01,
123
+ "conv_layout": true,
124
+ "context_duration": 10.0
125
+ },
126
+ {
127
+ "module_type": "PatchedPretransform",
128
+ "patch_size": 2
129
+ },
130
+ {
131
+ "module_type": "Transformer",
132
+ "input_dimension": 1280,
133
+ "output_dimension": 768,
134
+ "d_model": 1280,
135
+ "num_heads": 20,
136
+ "num_layers": 32,
137
+ "dim_feedforward": 5120,
138
+ "causal": true,
139
+ "norm": "layer_norm",
140
+ "positional_embedding": "rope",
141
+ "max_period": 10000,
142
+ "gating": "none",
143
+ "layer_scale": 0.01,
144
+ "conv_layout": true,
145
+ "context_duration": 10.0
146
+ }
147
+ ],
148
+ "decoder_kwargs": [
149
+ {
150
+ "module_type": "Transformer",
151
+ "input_dimension": 768,
152
+ "output_dimension": 1280,
153
+ "d_model": 1280,
154
+ "num_heads": 20,
155
+ "num_layers": 32,
156
+ "dim_feedforward": 5120,
157
+ "causal": true,
158
+ "norm": "layer_norm",
159
+ "positional_embedding": "rope",
160
+ "max_period": 10000,
161
+ "gating": "none",
162
+ "layer_scale": 0.01,
163
+ "conv_layout": true,
164
+ "context_duration": 10.0
165
+ },
166
+ {
167
+ "module_type": "PatchedPretransform",
168
+ "patch_size": 2
169
+ },
170
+ {
171
+ "module_type": "Transformer",
172
+ "input_dimension": 640,
173
+ "output_dimension": 768,
174
+ "d_model": 768,
175
+ "num_heads": 12,
176
+ "num_layers": 12,
177
+ "dim_feedforward": 3072,
178
+ "causal": true,
179
+ "norm": "layer_norm",
180
+ "positional_embedding": "rope",
181
+ "max_period": 10000,
182
+ "gating": "none",
183
+ "layer_scale": 0.01,
184
+ "conv_layout": true,
185
+ "context_duration": 10.0
186
+ },
187
+ {
188
+ "module_type": "PatchedPretransform",
189
+ "patch_size": 2
190
+ },
191
+ {
192
+ "module_type": "Transformer",
193
+ "input_dimension": 384,
194
+ "output_dimension": 768,
195
+ "d_model": 768,
196
+ "num_heads": 12,
197
+ "num_layers": 12,
198
+ "dim_feedforward": 3072,
199
+ "causal": true,
200
+ "norm": "layer_norm",
201
+ "positional_embedding": "rope",
202
+ "max_period": 10000,
203
+ "gating": "none",
204
+ "layer_scale": 0.01,
205
+ "conv_layout": true,
206
+ "context_duration": 8.0
207
+ },
208
+ {
209
+ "module_type": "PatchedPretransform",
210
+ "patch_size": 2
211
+ },
212
+ {
213
+ "module_type": "Transformer",
214
+ "input_dimension": 384,
215
+ "output_dimension": 768,
216
+ "d_model": 768,
217
+ "num_heads": 12,
218
+ "num_layers": 12,
219
+ "dim_feedforward": 3072,
220
+ "causal": true,
221
+ "norm": "layer_norm",
222
+ "positional_embedding": "rope",
223
+ "max_period": 10000,
224
+ "gating": "none",
225
+ "layer_scale": 0.01,
226
+ "conv_layout": true,
227
+ "context_duration": 4.0
228
+ },
229
+ {
230
+ "module_type": "PatchedPretransform",
231
+ "patch_size": 2
232
+ },
233
+ {
234
+ "module_type": "Transformer",
235
+ "input_dimension": 384,
236
+ "output_dimension": 768,
237
+ "d_model": 768,
238
+ "num_heads": 12,
239
+ "num_layers": 12,
240
+ "dim_feedforward": 3072,
241
+ "causal": true,
242
+ "norm": "layer_norm",
243
+ "positional_embedding": "rope",
244
+ "max_period": 10000,
245
+ "gating": "none",
246
+ "layer_scale": 0.01,
247
+ "conv_layout": true,
248
+ "context_duration": 2.0
249
+ },
250
+ {
251
+ "module_type": "PatchedPretransform",
252
+ "patch_size": 2
253
+ },
254
+ {
255
+ "module_type": "Transformer",
256
+ "input_dimension": 384,
257
+ "output_dimension": 240,
258
+ "d_model": 768,
259
+ "num_heads": 12,
260
+ "num_layers": 12,
261
+ "dim_feedforward": 3072,
262
+ "causal": true,
263
+ "norm": "layer_norm",
264
+ "positional_embedding": "rope",
265
+ "max_period": 10000,
266
+ "gating": "none",
267
+ "layer_scale": 0.01,
268
+ "conv_layout": true,
269
+ "context_duration": 1.0
270
+ },
271
+ {
272
+ "module_type": "PatchedPretransform",
273
+ "patch_size": 240
274
+ }
275
+ ],
276
+ "reversed_decoder_kwargs": [
277
+ {
278
+ "module_type": "PatchedPretransform",
279
+ "patch_size": 240
280
+ },
281
+ {
282
+ "module_type": "Transformer",
283
+ "input_dimension": 240,
284
+ "output_dimension": 384,
285
+ "d_model": 768,
286
+ "num_heads": 12,
287
+ "num_layers": 12,
288
+ "dim_feedforward": 3072,
289
+ "causal": true,
290
+ "norm": "layer_norm",
291
+ "positional_embedding": "rope",
292
+ "max_period": 10000,
293
+ "gating": "none",
294
+ "layer_scale": 0.01,
295
+ "conv_layout": true,
296
+ "context_duration": 1.0
297
+ },
298
+ {
299
+ "module_type": "PatchedPretransform",
300
+ "patch_size": 2
301
+ },
302
+ {
303
+ "module_type": "Transformer",
304
+ "input_dimension": 768,
305
+ "output_dimension": 384,
306
+ "d_model": 768,
307
+ "num_heads": 12,
308
+ "num_layers": 12,
309
+ "dim_feedforward": 3072,
310
+ "causal": true,
311
+ "norm": "layer_norm",
312
+ "positional_embedding": "rope",
313
+ "max_period": 10000,
314
+ "gating": "none",
315
+ "layer_scale": 0.01,
316
+ "conv_layout": true,
317
+ "context_duration": 2.0
318
+ },
319
+ {
320
+ "module_type": "PatchedPretransform",
321
+ "patch_size": 2
322
+ },
323
+ {
324
+ "module_type": "Transformer",
325
+ "input_dimension": 768,
326
+ "output_dimension": 384,
327
+ "d_model": 768,
328
+ "num_heads": 12,
329
+ "num_layers": 12,
330
+ "dim_feedforward": 3072,
331
+ "causal": true,
332
+ "norm": "layer_norm",
333
+ "positional_embedding": "rope",
334
+ "max_period": 10000,
335
+ "gating": "none",
336
+ "layer_scale": 0.01,
337
+ "conv_layout": true,
338
+ "context_duration": 4.0
339
+ },
340
+ {
341
+ "module_type": "PatchedPretransform",
342
+ "patch_size": 2
343
+ },
344
+ {
345
+ "module_type": "Transformer",
346
+ "input_dimension": 768,
347
+ "output_dimension": 384,
348
+ "d_model": 768,
349
+ "num_heads": 12,
350
+ "num_layers": 12,
351
+ "dim_feedforward": 3072,
352
+ "causal": true,
353
+ "norm": "layer_norm",
354
+ "positional_embedding": "rope",
355
+ "max_period": 10000,
356
+ "gating": "none",
357
+ "layer_scale": 0.01,
358
+ "conv_layout": true,
359
+ "context_duration": 8.0
360
+ },
361
+ {
362
+ "module_type": "PatchedPretransform",
363
+ "patch_size": 2
364
+ },
365
+ {
366
+ "module_type": "Transformer",
367
+ "input_dimension": 768,
368
+ "output_dimension": 640,
369
+ "d_model": 768,
370
+ "num_heads": 12,
371
+ "num_layers": 12,
372
+ "dim_feedforward": 3072,
373
+ "causal": true,
374
+ "norm": "layer_norm",
375
+ "positional_embedding": "rope",
376
+ "max_period": 10000,
377
+ "gating": "none",
378
+ "layer_scale": 0.01,
379
+ "conv_layout": true,
380
+ "context_duration": 10.0
381
+ },
382
+ {
383
+ "module_type": "PatchedPretransform",
384
+ "patch_size": 2
385
+ },
386
+ {
387
+ "module_type": "Transformer",
388
+ "input_dimension": 1280,
389
+ "output_dimension": 768,
390
+ "d_model": 1280,
391
+ "num_heads": 20,
392
+ "num_layers": 32,
393
+ "dim_feedforward": 5120,
394
+ "causal": true,
395
+ "norm": "layer_norm",
396
+ "positional_embedding": "rope",
397
+ "max_period": 10000,
398
+ "gating": "none",
399
+ "layer_scale": 0.01,
400
+ "conv_layout": true,
401
+ "context_duration": 10.0
402
+ }
403
+ ],
404
+ "quantizer_type": "rlfq",
405
+ "quantizer_kwargs": {
406
+ "input_dim": 768,
407
+ "rvq_dim": 512,
408
+ "output_dim": 768,
409
+ "num_quantizers": 32,
410
+ "codebook_size": 1024,
411
+ "codebook_dim": 8,
412
+ "quantizer_type": "rlfq"
413
+ },
414
+ "transformers_version": "4.56.0.dev0",
415
+ "codec_weight_dtype": "bf16"
416
+ }
local_v15/codec/decoder.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f34057f2184b161ca76d9ad66eeb63d5ae0826b7371ab7a607689843c77f958
3
+ size 2122467904
local_v15/codec/encoder.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e574dd890f7f744c26be00f67ffe5c22fb46bf3820fc14048c3006bedf2347d0
3
+ size 2122467840
local_v15/codec/model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff
 
local_v15/codec/quantizer.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4334c5d9f86c6b6edda8c06f84f7e80d9831a3e67f9952b8dbfc6dae4389c678
3
+ size 5414112
local_v15/codec/sha256.json ADDED
The diff for this file is too large to render. See raw diff
 
local_v15/model/added_tokens.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|audio_end|>": 151670,
9
+ "<|audio_pad|>": 151671,
10
+ "<|audio_start|>": 151669,
11
+ "<|box_end|>": 151649,
12
+ "<|box_start|>": 151648,
13
+ "<|endoftext|>": 151643,
14
+ "<|file_sep|>": 151664,
15
+ "<|fim_middle|>": 151660,
16
+ "<|fim_pad|>": 151662,
17
+ "<|fim_prefix|>": 151659,
18
+ "<|fim_suffix|>": 151661,
19
+ "<|im_end|>": 151645,
20
+ "<|im_start|>": 151644,
21
+ "<|image_pad|>": 151655,
22
+ "<|object_ref_end|>": 151647,
23
+ "<|object_ref_start|>": 151646,
24
+ "<|quad_end|>": 151651,
25
+ "<|quad_start|>": 151650,
26
+ "<|repo_name|>": 151663,
27
+ "<|video_pad|>": 151656,
28
+ "<|vision_end|>": 151653,
29
+ "<|vision_pad|>": 151654,
30
+ "<|vision_start|>": 151652
31
+ }
local_v15/model/chat_template.jinja ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- if tools %}
2
+ {{- '<|im_start|>system\n' }}
3
+ {%- if messages[0].role == 'system' %}
4
+ {{- messages[0].content + '\n\n' }}
5
+ {%- endif %}
6
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
7
+ {%- for tool in tools %}
8
+ {{- "\n" }}
9
+ {{- tool | tojson }}
10
+ {%- endfor %}
11
+ {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
12
+ {%- else %}
13
+ {%- if messages[0].role == 'system' %}
14
+ {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
15
+ {%- endif %}
16
+ {%- endif %}
17
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
18
+ {%- for message in messages[::-1] %}
19
+ {%- set index = (messages|length - 1) - loop.index0 %}
20
+ {%- if ns.multi_step_tool and message.role == "user" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
21
+ {%- set ns.multi_step_tool = false %}
22
+ {%- set ns.last_query_index = index %}
23
+ {%- endif %}
24
+ {%- endfor %}
25
+ {%- for message in messages %}
26
+ {%- if message.content is string %}
27
+ {%- set content = message.content %}
28
+ {%- else %}
29
+ {%- set content = '' %}
30
+ {%- endif %}
31
+ {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
32
+ {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
33
+ {%- elif message.role == "assistant" %}
34
+ {%- set reasoning_content = '' %}
35
+ {%- if message.reasoning_content is string %}
36
+ {%- set reasoning_content = message.reasoning_content %}
37
+ {%- else %}
38
+ {%- if '</think>' in content %}
39
+ {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
40
+ {%- set content = content.split('</think>')[-1].lstrip('\n') %}
41
+ {%- endif %}
42
+ {%- endif %}
43
+ {%- if loop.index0 > ns.last_query_index %}
44
+ {%- if loop.last or (not loop.last and reasoning_content) %}
45
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
46
+ {%- else %}
47
+ {{- '<|im_start|>' + message.role + '\n' + content }}
48
+ {%- endif %}
49
+ {%- else %}
50
+ {{- '<|im_start|>' + message.role + '\n' + content }}
51
+ {%- endif %}
52
+ {%- if message.tool_calls %}
53
+ {%- for tool_call in message.tool_calls %}
54
+ {%- if (loop.first and content) or (not loop.first) %}
55
+ {{- '\n' }}
56
+ {%- endif %}
57
+ {%- if tool_call.function %}
58
+ {%- set tool_call = tool_call.function %}
59
+ {%- endif %}
60
+ {{- '<tool_call>\n{"name": "' }}
61
+ {{- tool_call.name }}
62
+ {{- '", "arguments": ' }}
63
+ {%- if tool_call.arguments is string %}
64
+ {{- tool_call.arguments }}
65
+ {%- else %}
66
+ {{- tool_call.arguments | tojson }}
67
+ {%- endif %}
68
+ {{- '}\n</tool_call>' }}
69
+ {%- endfor %}
70
+ {%- endif %}
71
+ {{- '<|im_end|>\n' }}
72
+ {%- elif message.role == "tool" %}
73
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
74
+ {{- '<|im_start|>user' }}
75
+ {%- endif %}
76
+ {{- '\n<tool_response>\n' }}
77
+ {{- content }}
78
+ {{- '\n</tool_response>' }}
79
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
80
+ {{- '<|im_end|>\n' }}
81
+ {%- endif %}
82
+ {%- endif %}
83
+ {%- endfor %}
84
+ {%- if add_generation_prompt %}
85
+ {{- '<|im_start|>assistant\n' }}
86
+ {%- if enable_thinking is defined and enable_thinking is false %}
87
+ {{- '<think>\n\n</think>\n\n' }}
88
+ {%- endif %}
89
+ {%- endif %}
local_v15/model/config.json ADDED
@@ -0,0 +1,381 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "moss_tts_local",
3
+ "architectures": [
4
+ "MossTTSLocalModel"
5
+ ],
6
+ "auto_map": {
7
+ "AutoConfig": "configuration_moss_tts.MossTTSLocalConfig",
8
+ "AutoModel": "modeling_moss_tts.MossTTSLocalModel",
9
+ "AutoProcessor": "processing_moss_tts.MossTTSLocalProcessor"
10
+ },
11
+ "processor_class": "MossTTSLocalProcessor",
12
+ "qwen3_config": {
13
+ "_name_or_path": "",
14
+ "add_cross_attention": false,
15
+ "architectures": [
16
+ "Qwen3ForCausalLM"
17
+ ],
18
+ "attention_bias": false,
19
+ "attention_dropout": 0.0,
20
+ "bad_words_ids": null,
21
+ "begin_suppress_tokens": null,
22
+ "bos_token_id": 151643,
23
+ "chunk_size_feed_forward": 0,
24
+ "cross_attention_hidden_size": null,
25
+ "decoder_start_token_id": null,
26
+ "diversity_penalty": 0.0,
27
+ "do_sample": false,
28
+ "dtype": "bfloat16",
29
+ "early_stopping": false,
30
+ "encoder_no_repeat_ngram_size": 0,
31
+ "eos_token_id": 151643,
32
+ "exponential_decay_length_penalty": null,
33
+ "finetuning_task": null,
34
+ "forced_bos_token_id": null,
35
+ "forced_eos_token_id": null,
36
+ "gradient_checkpointing_use_reentrant": false,
37
+ "head_dim": 128,
38
+ "hidden_act": "silu",
39
+ "hidden_size": 2560,
40
+ "id2label": {
41
+ "0": "LABEL_0",
42
+ "1": "LABEL_1"
43
+ },
44
+ "initializer_range": 0.02,
45
+ "intermediate_size": 9728,
46
+ "is_decoder": false,
47
+ "is_encoder_decoder": false,
48
+ "label2id": {
49
+ "LABEL_0": 0,
50
+ "LABEL_1": 1
51
+ },
52
+ "layer_types": [
53
+ "full_attention",
54
+ "full_attention",
55
+ "full_attention",
56
+ "full_attention",
57
+ "full_attention",
58
+ "full_attention",
59
+ "full_attention",
60
+ "full_attention",
61
+ "full_attention",
62
+ "full_attention",
63
+ "full_attention",
64
+ "full_attention",
65
+ "full_attention",
66
+ "full_attention",
67
+ "full_attention",
68
+ "full_attention",
69
+ "full_attention",
70
+ "full_attention",
71
+ "full_attention",
72
+ "full_attention",
73
+ "full_attention",
74
+ "full_attention",
75
+ "full_attention",
76
+ "full_attention",
77
+ "full_attention",
78
+ "full_attention",
79
+ "full_attention",
80
+ "full_attention",
81
+ "full_attention",
82
+ "full_attention",
83
+ "full_attention",
84
+ "full_attention",
85
+ "full_attention",
86
+ "full_attention",
87
+ "full_attention",
88
+ "full_attention"
89
+ ],
90
+ "length_penalty": 1.0,
91
+ "max_length": 20,
92
+ "max_position_embeddings": 32768,
93
+ "max_window_layers": 36,
94
+ "min_length": 0,
95
+ "model_type": "qwen3",
96
+ "no_repeat_ngram_size": 0,
97
+ "num_attention_heads": 32,
98
+ "num_beam_groups": 1,
99
+ "num_beams": 1,
100
+ "num_hidden_layers": 36,
101
+ "num_key_value_heads": 8,
102
+ "num_return_sequences": 1,
103
+ "output_attentions": false,
104
+ "output_hidden_states": false,
105
+ "output_scores": false,
106
+ "pad_token_id": 151643,
107
+ "prefix": null,
108
+ "problem_type": null,
109
+ "pruned_heads": {},
110
+ "remove_invalid_values": false,
111
+ "repetition_penalty": 1.0,
112
+ "return_dict": true,
113
+ "return_dict_in_generate": false,
114
+ "rms_norm_eps": 1e-06,
115
+ "rope_scaling": null,
116
+ "rope_theta": 1000000,
117
+ "sep_token_id": null,
118
+ "sliding_window": null,
119
+ "suppress_tokens": null,
120
+ "task_specific_params": null,
121
+ "temperature": 1.0,
122
+ "tf_legacy_loss": false,
123
+ "tie_encoder_decoder": false,
124
+ "tie_word_embeddings": true,
125
+ "tokenizer_class": null,
126
+ "top_k": 50,
127
+ "top_p": 1.0,
128
+ "torchscript": false,
129
+ "transformers_version": "4.57.1",
130
+ "typical_p": 1.0,
131
+ "use_bfloat16": false,
132
+ "use_cache": false,
133
+ "use_sliding_window": false,
134
+ "vocab_size": 151936
135
+ },
136
+ "language_config": {
137
+ "_name_or_path": "",
138
+ "add_cross_attention": false,
139
+ "architectures": [
140
+ "Qwen3ForCausalLM"
141
+ ],
142
+ "attention_bias": false,
143
+ "attention_dropout": 0.0,
144
+ "bad_words_ids": null,
145
+ "begin_suppress_tokens": null,
146
+ "bos_token_id": 151643,
147
+ "chunk_size_feed_forward": 0,
148
+ "cross_attention_hidden_size": null,
149
+ "decoder_start_token_id": null,
150
+ "diversity_penalty": 0.0,
151
+ "do_sample": false,
152
+ "dtype": "bfloat16",
153
+ "early_stopping": false,
154
+ "encoder_no_repeat_ngram_size": 0,
155
+ "eos_token_id": 151643,
156
+ "exponential_decay_length_penalty": null,
157
+ "finetuning_task": null,
158
+ "forced_bos_token_id": null,
159
+ "forced_eos_token_id": null,
160
+ "gradient_checkpointing_use_reentrant": false,
161
+ "head_dim": 128,
162
+ "hidden_act": "silu",
163
+ "hidden_size": 2560,
164
+ "id2label": {
165
+ "0": "LABEL_0",
166
+ "1": "LABEL_1"
167
+ },
168
+ "initializer_range": 0.02,
169
+ "intermediate_size": 9728,
170
+ "is_decoder": false,
171
+ "is_encoder_decoder": false,
172
+ "label2id": {
173
+ "LABEL_0": 0,
174
+ "LABEL_1": 1
175
+ },
176
+ "layer_types": [
177
+ "full_attention",
178
+ "full_attention",
179
+ "full_attention",
180
+ "full_attention",
181
+ "full_attention",
182
+ "full_attention",
183
+ "full_attention",
184
+ "full_attention",
185
+ "full_attention",
186
+ "full_attention",
187
+ "full_attention",
188
+ "full_attention",
189
+ "full_attention",
190
+ "full_attention",
191
+ "full_attention",
192
+ "full_attention",
193
+ "full_attention",
194
+ "full_attention",
195
+ "full_attention",
196
+ "full_attention",
197
+ "full_attention",
198
+ "full_attention",
199
+ "full_attention",
200
+ "full_attention",
201
+ "full_attention",
202
+ "full_attention",
203
+ "full_attention",
204
+ "full_attention",
205
+ "full_attention",
206
+ "full_attention",
207
+ "full_attention",
208
+ "full_attention",
209
+ "full_attention",
210
+ "full_attention",
211
+ "full_attention",
212
+ "full_attention"
213
+ ],
214
+ "length_penalty": 1.0,
215
+ "max_length": 20,
216
+ "max_position_embeddings": 32768,
217
+ "max_window_layers": 36,
218
+ "min_length": 0,
219
+ "model_type": "qwen3",
220
+ "no_repeat_ngram_size": 0,
221
+ "num_attention_heads": 32,
222
+ "num_beam_groups": 1,
223
+ "num_beams": 1,
224
+ "num_hidden_layers": 36,
225
+ "num_key_value_heads": 8,
226
+ "num_return_sequences": 1,
227
+ "output_attentions": false,
228
+ "output_hidden_states": false,
229
+ "output_scores": false,
230
+ "pad_token_id": 151643,
231
+ "prefix": null,
232
+ "problem_type": null,
233
+ "pruned_heads": {},
234
+ "remove_invalid_values": false,
235
+ "repetition_penalty": 1.0,
236
+ "return_dict": true,
237
+ "return_dict_in_generate": false,
238
+ "rms_norm_eps": 1e-06,
239
+ "rope_scaling": null,
240
+ "rope_theta": 1000000,
241
+ "sep_token_id": null,
242
+ "sliding_window": null,
243
+ "suppress_tokens": null,
244
+ "task_specific_params": null,
245
+ "temperature": 1.0,
246
+ "tf_legacy_loss": false,
247
+ "tie_encoder_decoder": false,
248
+ "tie_word_embeddings": true,
249
+ "tokenizer_class": null,
250
+ "top_k": 50,
251
+ "top_p": 1.0,
252
+ "torchscript": false,
253
+ "transformers_version": "4.57.1",
254
+ "typical_p": 1.0,
255
+ "use_bfloat16": false,
256
+ "use_cache": false,
257
+ "use_sliding_window": false,
258
+ "vocab_size": 151936
259
+ },
260
+ "gpt2_config": {
261
+ "_name_or_path": "",
262
+ "activation_function": "silu",
263
+ "add_cross_attention": false,
264
+ "architectures": null,
265
+ "attn_pdrop": 0.0,
266
+ "bad_words_ids": null,
267
+ "begin_suppress_tokens": null,
268
+ "bos_token_id": null,
269
+ "chunk_size_feed_forward": 0,
270
+ "cross_attention_hidden_size": null,
271
+ "decoder_start_token_id": null,
272
+ "diversity_penalty": 0.0,
273
+ "do_sample": false,
274
+ "dtype": null,
275
+ "early_stopping": false,
276
+ "embd_pdrop": 0.0,
277
+ "encoder_no_repeat_ngram_size": 0,
278
+ "eos_token_id": 151645,
279
+ "exponential_decay_length_penalty": null,
280
+ "finetuning_task": null,
281
+ "forced_bos_token_id": null,
282
+ "forced_eos_token_id": null,
283
+ "id2label": {
284
+ "0": "LABEL_0",
285
+ "1": "LABEL_1"
286
+ },
287
+ "initializer_range": 0.02,
288
+ "is_decoder": false,
289
+ "is_encoder_decoder": false,
290
+ "label2id": {
291
+ "LABEL_0": 0,
292
+ "LABEL_1": 1
293
+ },
294
+ "layer_norm_epsilon": 1e-06,
295
+ "length_penalty": 1.0,
296
+ "max_length": 20,
297
+ "min_length": 0,
298
+ "model_type": "gpt2",
299
+ "n_ctx": 10240,
300
+ "n_embd": 2560,
301
+ "n_head": 32,
302
+ "n_inner": 9728,
303
+ "n_layer": 1,
304
+ "n_positions": 10240,
305
+ "no_repeat_ngram_size": 0,
306
+ "num_beam_groups": 1,
307
+ "num_beams": 1,
308
+ "num_return_sequences": 1,
309
+ "output_attentions": false,
310
+ "output_hidden_states": false,
311
+ "output_scores": false,
312
+ "pad_token_id": null,
313
+ "position_embedding_type": "rope",
314
+ "prefix": null,
315
+ "problem_type": null,
316
+ "pruned_heads": {},
317
+ "remove_invalid_values": false,
318
+ "reorder_and_upcast_attn": false,
319
+ "repetition_penalty": 1.0,
320
+ "resid_pdrop": 0.0,
321
+ "return_dict": true,
322
+ "return_dict_in_generate": false,
323
+ "rope_base": 1000000.0,
324
+ "scale_attn_by_inverse_layer_idx": false,
325
+ "scale_attn_weights": true,
326
+ "sep_token_id": null,
327
+ "summary_activation": null,
328
+ "summary_first_dropout": 0.1,
329
+ "summary_proj_to_labels": true,
330
+ "summary_type": "cls_index",
331
+ "summary_use_proj": true,
332
+ "suppress_tokens": null,
333
+ "task_specific_params": null,
334
+ "temperature": 1.0,
335
+ "tf_legacy_loss": false,
336
+ "tie_encoder_decoder": false,
337
+ "tie_word_embeddings": true,
338
+ "tokenizer_class": null,
339
+ "top_k": 50,
340
+ "top_p": 1.0,
341
+ "torchscript": false,
342
+ "transformers_version": "4.57.1",
343
+ "typical_p": 1.0,
344
+ "use_bfloat16": false,
345
+ "use_cache": true,
346
+ "vocab_size": 151936
347
+ },
348
+ "n_vq": 12,
349
+ "audio_vocab_size": 1024,
350
+ "audio_codebook_sizes": [
351
+ 1024,
352
+ 1024,
353
+ 1024,
354
+ 1024,
355
+ 1024,
356
+ 1024,
357
+ 1024,
358
+ 1024,
359
+ 1024,
360
+ 1024,
361
+ 1024,
362
+ 1024
363
+ ],
364
+ "audio_pad_token_id": 1024,
365
+ "audio_pad_code": 1024,
366
+ "pad_token_id": 151643,
367
+ "im_start_token_id": 151644,
368
+ "im_end_token_id": 151645,
369
+ "audio_start_token_id": 151669,
370
+ "audio_end_token_id": 151670,
371
+ "audio_user_slot_token_id": 151654,
372
+ "audio_assistant_slot_token_id": 151656,
373
+ "audio_assistant_gen_slot_token_id": 151656,
374
+ "sampling_rate": 48000,
375
+ "audio_tokenizer_name_or_path": "OpenMOSS-Team/MOSS-Audio-Tokenizer-v2",
376
+ "attn_implementation": "flash_attention_2",
377
+ "local_transformer_layers": 1,
378
+ "local_text_head_mode": "binary",
379
+ "use_static_local_kv_cache": true,
380
+ "initializer_range": 0.02
381
+ }
local_v15/model/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
local_v15/model/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:608f1ff64bc6caa9be836060fc7c78a15c4658c4a07b8d73c78d6f70d1b39c23
3
+ size 9100859544
local_v15/model/processor_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "processor_class": "MossTTSLocalProcessor",
3
+ "audio_tokenizer_name_or_path": "OpenMOSS-Team/MOSS-Audio-Tokenizer-v2",
4
+ "auto_map": {
5
+ "AutoProcessor": "processing_moss_tts.MossTTSLocalProcessor"
6
+ }
7
+ }
local_v15/model/special_tokens_map.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|audio_start|>",
4
+ "<|audio_end|>",
5
+ "<|audio_pad|>"
6
+ ],
7
+ "eos_token": {
8
+ "content": "<|im_end|>",
9
+ "lstrip": false,
10
+ "normalized": false,
11
+ "rstrip": false,
12
+ "single_word": false
13
+ },
14
+ "pad_token": {
15
+ "content": "<|endoftext|>",
16
+ "lstrip": false,
17
+ "normalized": false,
18
+ "rstrip": false,
19
+ "single_word": false
20
+ }
21
+ }
local_v15/model/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06902d1fb775216338802205886a24bc715ccc606bd872a892e3d3c83ca1b9e2
3
+ size 11423220
local_v15/model/tokenizer_config.json ADDED
@@ -0,0 +1,253 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ },
213
+ "151669": {
214
+ "content": "<|audio_start|>",
215
+ "lstrip": false,
216
+ "normalized": false,
217
+ "rstrip": false,
218
+ "single_word": false,
219
+ "special": true
220
+ },
221
+ "151670": {
222
+ "content": "<|audio_end|>",
223
+ "lstrip": false,
224
+ "normalized": false,
225
+ "rstrip": false,
226
+ "single_word": false,
227
+ "special": true
228
+ },
229
+ "151671": {
230
+ "content": "<|audio_pad|>",
231
+ "lstrip": false,
232
+ "normalized": false,
233
+ "rstrip": false,
234
+ "single_word": false,
235
+ "special": true
236
+ }
237
+ },
238
+ "additional_special_tokens": [
239
+ "<|audio_start|>",
240
+ "<|audio_end|>",
241
+ "<|audio_pad|>"
242
+ ],
243
+ "bos_token": null,
244
+ "clean_up_tokenization_spaces": false,
245
+ "eos_token": "<|im_end|>",
246
+ "errors": "replace",
247
+ "extra_special_tokens": {},
248
+ "model_max_length": 131072,
249
+ "pad_token": "<|endoftext|>",
250
+ "split_special_tokens": false,
251
+ "tokenizer_class": "Qwen2Tokenizer",
252
+ "unk_token": null
253
+ }
local_v15/model/vocab.json ADDED
The diff for this file is too large to render. See raw diff