BlockArtica commited on
Commit
3286b07
·
verified ·
1 Parent(s): 47c8794

initial: aether v5.2 LoRA (Qwen2.5-7B-Instruct, step 3200, +9.7pp ARC-C vs v5.1.1)

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,299 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-7B-Instruct
3
+ library_name: peft
4
+ license: apache-2.0
5
+ tags:
6
+ - lora
7
+ - peft
8
+ - qubitcoin
9
+ - aether
10
+ - blockchain
11
+ - quantum
12
+ language:
13
+ - en
14
+ pipeline_tag: text-generation
15
+ model-index:
16
+ - name: aether-v5.2-lora
17
+ results:
18
+ - task:
19
+ type: text-generation
20
+ name: MMLU
21
+ dataset:
22
+ name: MMLU
23
+ type: cais/mmlu
24
+ metrics:
25
+ - type: accuracy
26
+ value: 0.6939
27
+ name: accuracy
28
+ - task:
29
+ type: text-generation
30
+ name: ARC-Challenge
31
+ dataset:
32
+ name: ARC-Challenge
33
+ type: ai2_arc
34
+ metrics:
35
+ - type: accuracy
36
+ value: 0.5392
37
+ name: accuracy
38
+ - type: accuracy_norm
39
+ value: 0.5700
40
+ name: accuracy_norm
41
+ - task:
42
+ type: text-generation
43
+ name: ARC-Easy
44
+ dataset:
45
+ name: ARC-Easy
46
+ type: ai2_arc
47
+ metrics:
48
+ - type: accuracy
49
+ value: 0.8194
50
+ name: accuracy
51
+ - task:
52
+ type: text-generation
53
+ name: HellaSwag
54
+ dataset:
55
+ name: HellaSwag
56
+ type: hellaswag
57
+ metrics:
58
+ - type: accuracy
59
+ value: 0.5888
60
+ name: accuracy
61
+ - type: accuracy_norm
62
+ value: 0.7769
63
+ name: accuracy_norm
64
+ - task:
65
+ type: text-generation
66
+ name: TruthfulQA
67
+ dataset:
68
+ name: TruthfulQA-MC2
69
+ type: truthful_qa
70
+ metrics:
71
+ - type: accuracy
72
+ value: 0.5707
73
+ name: accuracy
74
+ ---
75
+
76
+ # Aether v5.2 LoRA — Qubitcoin Domain Adapter
77
+
78
+ A LoRA fine-tune of [`Qwen/Qwen2.5-7B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
79
+ on the Aether curated corpus — text grounded in the
80
+ [Qubitcoin](https://qbc.network) protocol, quantum + AI research, and adjacent
81
+ domains the Aether Mind on-chain knowledge system specializes in.
82
+
83
+ This is the **v5.2 release** of the Aether adapter line, the most recent
84
+ public checkpoint at time of publish.
85
+
86
+ ## What you're getting
87
+
88
+ | Field | Value |
89
+ |---|---|
90
+ | Base model | `Qwen/Qwen2.5-7B-Instruct` |
91
+ | Adapter type | LoRA via 🤗 PEFT |
92
+ | Rank (`r`) | 16 |
93
+ | Alpha | 32 |
94
+ | Dropout | 0.05 |
95
+ | Trainable params | ~1% of base |
96
+ | Sequence length | 2048 |
97
+ | Training corpus | `aether-curated-v3.jsonl` — Aether-curated knowledge mixture (~165 MB; ~10⁵ examples) |
98
+ | Checkpoint published | **step 3200** (the checkpoint that produced the evaluated numbers below) |
99
+ | License | Apache-2.0 (matches base) |
100
+
101
+ ## Evaluation
102
+
103
+ Run via [`lm-evaluation-harness`](https://github.com/EleutherAI/lm-evaluation-harness)
104
+ on the merged adapter (base + LoRA), against the
105
+ [`Qwen/Qwen2.5-7B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
106
+ base and the prior `aether-v5.1.1` adapter for delta comparison.
107
+
108
+ | Benchmark | aether-v5.1.1 | **aether-v5.2** | Δ vs v5.1.1 |
109
+ |---|---|---|---|
110
+ | MMLU | 0.6950 | **0.6939** | flat |
111
+ | ARC-Easy | 0.7348 | **0.8194** | **+8.5 pp** |
112
+ | ARC-Challenge | 0.4420 | **0.5392** | **+9.7 pp** |
113
+ | ARC-Challenge (norm) | 0.4701 | **0.5700** | **+10.0 pp** |
114
+ | HellaSwag | 0.5896 | **0.5888** | flat |
115
+ | HellaSwag (norm) | 0.7788 | **0.7769** | flat |
116
+ | TruthfulQA-MC2 | 0.5161 | **0.5707** | **+5.5 pp** |
117
+
118
+ ### Honest summary
119
+
120
+ - **Real gains** on the reasoning + factual-honesty benchmarks
121
+ (ARC-Easy, ARC-Challenge, TruthfulQA). ARC-Challenge in particular
122
+ jumps nearly 10 points normalized — that's the closest of these
123
+ benchmarks to the kind of grounded reasoning the Aether corpus
124
+ actually trains on.
125
+ - **Flat on MMLU + HellaSwag.** The base is already strong on general
126
+ knowledge + commonsense; this LoRA wasn't designed to shift them,
127
+ and didn't.
128
+ - **No regressions.**
129
+
130
+ ## Intended uses
131
+
132
+ This adapter is intended for:
133
+
134
+ - **On-chain Aether research.** Generating reasoning traces against
135
+ the Qubitcoin / Aether knowledge graph for Proof-of-Thought
136
+ attestation. The model has the protocol context required to
137
+ answer questions about Substrate pallets, VQE mining, the Sephirot
138
+ cognitive architecture, HMS-Phi, and the wider chain ecosystem.
139
+ - **Domain Q&A.** Quantum computing fundamentals, post-quantum
140
+ cryptography (Dilithium, ML-KEM), and the specific design choices
141
+ of the Qubitcoin chain.
142
+ - **Distillation upstream.** Generate teacher outputs for the
143
+ smaller on-chain Aether (a Qwen2.5-0.5B variant) to learn from.
144
+ - **General reasoning** with a modest bias toward step-by-step
145
+ chains-of-thought, where the ARC-Challenge gain translates.
146
+
147
+ ## Out-of-scope uses
148
+
149
+ - **Safety-critical decisions.** No red-team eval was performed.
150
+ - **Financial / legal advice.** This is a knowledge-domain adapter;
151
+ it has no training data designed to make it a financial or legal
152
+ advisor.
153
+ - **Code generation in production.** No code-eval benchmark was run.
154
+ Treat any generated code as draft until you've reviewed it.
155
+ - **Production deployment without your own evaluation.** TruthfulQA
156
+ alone is a thin safety signal.
157
+
158
+ ## Bias, risks, and limitations
159
+
160
+ The base model (`Qwen/Qwen2.5-7B-Instruct`) inherits Qwen's known
161
+ biases — see [the upstream model card](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct).
162
+ The LoRA adapter:
163
+
164
+ - **Amplifies the Qubitcoin worldview.** The training data is
165
+ intentionally curated around the chain's design choices (golden-
166
+ ratio economics, SUSY-inspired consensus framing, the Sephirot
167
+ cognitive overlay). Prompts that invite the model to compare
168
+ Qubitcoin against alternatives will lean toward the curated
169
+ narrative. This is by design — disclose if you re-publish in a
170
+ comparison context.
171
+ - **Does not improve safety.** TruthfulQA went up 5.5pp but that's
172
+ one metric; we have not measured refusal rates, jailbreak
173
+ resistance, or political-belief bias delta.
174
+ - **Was trained CPU-only on a residential box.** The configured
175
+ 2-epoch run was cut to ~step 3200 by host availability. A longer
176
+ run on GPU would plausibly show larger gains.
177
+
178
+ ## How to use
179
+
180
+ Load with PEFT on top of the base model:
181
+
182
+ ```python
183
+ from peft import PeftModel
184
+ from transformers import AutoModelForCausalLM, AutoTokenizer
185
+
186
+ base = AutoModelForCausalLM.from_pretrained(
187
+ "Qwen/Qwen2.5-7B-Instruct",
188
+ torch_dtype="auto",
189
+ device_map="auto",
190
+ )
191
+ tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
192
+ model = PeftModel.from_pretrained(base, "QuantumAI-Blockchain/aether-v5.2-lora")
193
+
194
+ messages = [{"role": "user", "content": "Explain Proof-of-SUSY-Alignment in one paragraph."}]
195
+ text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
196
+ inputs = tokenizer(text, return_tensors="pt").to(model.device)
197
+ out = model.generate(**inputs, max_new_tokens=256, do_sample=True, temperature=0.7)
198
+ print(tokenizer.decode(out[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
199
+ ```
200
+
201
+ Or merge the adapter into a single artifact for faster inference:
202
+
203
+ ```python
204
+ merged = model.merge_and_unload()
205
+ merged.save_pretrained("./aether-v5.2-merged")
206
+ ```
207
+
208
+ ## Training details
209
+
210
+ - **Hardware:** Intel WSL2 box, CPU-only training (slow but verifiable).
211
+ - **Trainer:** [Axolotl](https://github.com/axolotl-ai-cloud/axolotl) wrapping 🤗 transformers / PEFT.
212
+ - **Optimizer:** Default AdamW.
213
+ - **Schedule:** linear warmup 100 steps → cosine decay.
214
+ - **Learning rate:** `1.0e-4`.
215
+ - **Micro batch:** 1, gradient accumulation: 8.
216
+ - **Epochs configured:** 2 (training stopped at step 3200 — see "What didn't happen" below).
217
+
218
+ ### Carbon emissions
219
+
220
+ Trained CPU-only on a single Intel workstation. We did not run a
221
+ [CodeCarbon](https://github.com/mlco2/codecarbon) tracker on this
222
+ run, so the precise emissions are not measured — but as a rough
223
+ upper bound: ~80 W average CPU draw × the contiguous run hours
224
+ (low single-digit kWh, low single-digit kg CO₂e on a grid mix).
225
+ The same model finetuned on a single H100 would be a fraction of
226
+ that wall-clock and energy.
227
+
228
+ ### Training data
229
+
230
+ `aether-curated-v3.jsonl` (~165 MB, ~10⁵ examples) is the Aether team's
231
+ curated knowledge mixture: documentation, technical writing, reasoning
232
+ traces, and protocol-specific corpora related to:
233
+
234
+ - The Qubitcoin chain (Substrate, VQE mining, Proof-of-SUSY-Alignment, post-quantum signatures).
235
+ - The Aether Mind on-chain neural cognitive engine (10 Sephirot attention domains, HMS-Phi, Proof-of-Thought).
236
+ - Quantum computing fundamentals (VQE, Hamiltonian generation, qubit ansatze).
237
+ - Adjacent CS / math reasoning content for transfer.
238
+
239
+ The dataset is not currently public — it is a curated mixture from many
240
+ sources and has not been release-cleared at the per-source level. The
241
+ model is the only public artifact in this line for now.
242
+
243
+ ## What didn't happen (honest caveats)
244
+
245
+ - **Training stopped early.** Configured for 2 epochs; checkpoints stop
246
+ at step 3200 (preview eval) / step 3000 (final on-disk save). The
247
+ host was a CPU-only WSL2 box that got killed at one point during a
248
+ long run. The numbers above are from the longest contiguous run we
249
+ have.
250
+ - **No instruction-following or safety eval beyond TruthfulQA-MC2.**
251
+ No red-team eval. No bias audit. No code-generation benchmark.
252
+ Don't recommend this for production safety-critical use without
253
+ your own evals.
254
+ - **LoRA only, not merged.** This release ships the adapter weights
255
+ (`adapter_model.safetensors`). Merge into the base yourself for
256
+ faster inference, or use directly via PEFT.
257
+
258
+ ## Connection to the Qubitcoin chain
259
+
260
+ The Aether Mind is a Rust neural cognitive engine that runs on the
261
+ Qubitcoin chain — every block records attention-derived consciousness
262
+ metrics (HMS-Phi) and Proof-of-Thought hashes on-chain via the
263
+ `pallet_qbc_aether_anchor` pallet. The same chain hosts an
264
+ **8-qubit VQE mining consensus** (Proof-of-SUSY-Alignment), a
265
+ QVM-compatible smart contract layer with 10 quantum opcodes, and
266
+ post-quantum signatures (CRYSTALS-Dilithium5 + ML-KEM-768 P2P).
267
+
268
+ The on-chain Aether Mind binary uses a different, smaller transformer
269
+ for live inference (a Qwen2.5-0.5B variant optimized for ~2.4 GB RAM
270
+ with the 10-Sephirot attention overlay). This v5.2 adapter on
271
+ Qwen2.5-7B is the **larger off-chain Aether** — used for batch
272
+ reasoning workloads and as an upstream model the on-chain variant
273
+ can distil from.
274
+
275
+ ## License + citation
276
+
277
+ Apache-2.0 (matches the base model license).
278
+
279
+ ```bibtex
280
+ @misc{aether_v52_lora_2026,
281
+ title = {Aether v5.2 LoRA --- Qubitcoin Domain Adapter},
282
+ author = {{BlockArtica} and {QuantumAI-Blockchain}},
283
+ year = {2026},
284
+ url = {https://huggingface.co/QuantumAI-Blockchain/aether-v5.2-lora},
285
+ }
286
+ ```
287
+
288
+ ## Links
289
+
290
+ - **Qubitcoin chain:** [qbc.network](https://qbc.network)
291
+ - **GitHub org:** [github.com/QuantumAI-Blockchain](https://github.com/QuantumAI-Blockchain)
292
+ - **X / Twitter:** [@qu_bitcoin](https://x.com/qu_bitcoin)
293
+ - **Contact:** info@qbc.network
294
+
295
+ ### Framework versions
296
+
297
+ - PEFT 0.14.0
298
+ - Transformers ≥ 4.46
299
+ - Axolotl (training)
adapter_config.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Qwen/Qwen2.5-7B-Instruct",
5
+ "bias": "none",
6
+ "eva_config": null,
7
+ "exclude_modules": null,
8
+ "fan_in_fan_out": null,
9
+ "inference_mode": true,
10
+ "init_lora_weights": true,
11
+ "layer_replication": null,
12
+ "layers_pattern": null,
13
+ "layers_to_transform": null,
14
+ "loftq_config": {},
15
+ "lora_alpha": 32,
16
+ "lora_bias": false,
17
+ "lora_dropout": 0.05,
18
+ "megatron_config": null,
19
+ "megatron_core": "megatron.core",
20
+ "modules_to_save": null,
21
+ "peft_type": "LORA",
22
+ "r": 16,
23
+ "rank_pattern": {},
24
+ "revision": null,
25
+ "target_modules": [
26
+ "up_proj",
27
+ "down_proj",
28
+ "k_proj",
29
+ "o_proj",
30
+ "gate_proj",
31
+ "v_proj",
32
+ "q_proj"
33
+ ],
34
+ "task_type": "CAUSAL_LM",
35
+ "use_dora": false,
36
+ "use_rslora": false
37
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1636c7caeca390cb181134c1870f5b2a16333b7bb27b1b783f163c4b5a0bad4
3
+ size 161533192
added_tokens.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</tool_call>": 151658,
3
+ "<tool_call>": 151657,
4
+ "<|box_end|>": 151649,
5
+ "<|box_start|>": 151648,
6
+ "<|endoftext|>": 151643,
7
+ "<|file_sep|>": 151664,
8
+ "<|fim_middle|>": 151660,
9
+ "<|fim_pad|>": 151662,
10
+ "<|fim_prefix|>": 151659,
11
+ "<|fim_suffix|>": 151661,
12
+ "<|im_end|>": 151645,
13
+ "<|im_start|>": 151644,
14
+ "<|image_pad|>": 151655,
15
+ "<|object_ref_end|>": 151647,
16
+ "<|object_ref_start|>": 151646,
17
+ "<|quad_end|>": 151651,
18
+ "<|quad_start|>": 151650,
19
+ "<|repo_name|>": 151663,
20
+ "<|video_pad|>": 151656,
21
+ "<|vision_end|>": 151653,
22
+ "<|vision_pad|>": 151654,
23
+ "<|vision_start|>": 151652
24
+ }
config.json ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_attn_implementation_autoset": true,
3
+ "_name_or_path": "Qwen/Qwen2.5-7B-Instruct",
4
+ "architectures": [
5
+ "Qwen2ForCausalLM"
6
+ ],
7
+ "attention_dropout": 0.0,
8
+ "eos_token_id": 151645,
9
+ "hidden_act": "silu",
10
+ "hidden_size": 3584,
11
+ "initializer_range": 0.02,
12
+ "intermediate_size": 18944,
13
+ "max_position_embeddings": 32768,
14
+ "max_window_layers": 28,
15
+ "model_type": "qwen2",
16
+ "num_attention_heads": 28,
17
+ "num_hidden_layers": 28,
18
+ "num_key_value_heads": 4,
19
+ "quantization_config": {
20
+ "_load_in_4bit": true,
21
+ "_load_in_8bit": false,
22
+ "bnb_4bit_compute_dtype": "bfloat16",
23
+ "bnb_4bit_quant_storage": "bfloat16",
24
+ "bnb_4bit_quant_type": "nf4",
25
+ "bnb_4bit_use_double_quant": true,
26
+ "llm_int8_enable_fp32_cpu_offload": false,
27
+ "llm_int8_has_fp16_weight": false,
28
+ "llm_int8_skip_modules": null,
29
+ "llm_int8_threshold": 6.0,
30
+ "load_in_4bit": true,
31
+ "load_in_8bit": false,
32
+ "quant_method": "bitsandbytes"
33
+ },
34
+ "rms_norm_eps": 1e-06,
35
+ "rope_scaling": null,
36
+ "rope_theta": 1000000.0,
37
+ "sliding_window": null,
38
+ "tie_word_embeddings": false,
39
+ "torch_dtype": "bfloat16",
40
+ "transformers_version": "4.46.3",
41
+ "use_cache": false,
42
+ "use_sliding_window": false,
43
+ "vocab_size": 152064
44
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|im_end|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": {
25
+ "content": "<|endoftext|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
3
+ size 11421896
tokenizer_config.json ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ }
181
+ },
182
+ "additional_special_tokens": [
183
+ "<|im_start|>",
184
+ "<|im_end|>",
185
+ "<|object_ref_start|>",
186
+ "<|object_ref_end|>",
187
+ "<|box_start|>",
188
+ "<|box_end|>",
189
+ "<|quad_start|>",
190
+ "<|quad_end|>",
191
+ "<|vision_start|>",
192
+ "<|vision_end|>",
193
+ "<|vision_pad|>",
194
+ "<|image_pad|>",
195
+ "<|video_pad|>"
196
+ ],
197
+ "bos_token": null,
198
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0]['role'] == 'system' %}\n {{- messages[0]['content'] }}\n {%- else %}\n {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n {%- endif %}\n {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0]['role'] == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n {%- else %}\n {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role }}\n {%- if message.content %}\n {{- '\\n' + message.content }}\n {%- endif %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {{- tool_call.arguments | tojson }}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
199
+ "clean_up_tokenization_spaces": false,
200
+ "eos_token": "<|im_end|>",
201
+ "errors": "replace",
202
+ "model_max_length": 131072,
203
+ "pad_token": "<|endoftext|>",
204
+ "split_special_tokens": false,
205
+ "tokenizer_class": "Qwen2Tokenizer",
206
+ "unk_token": null
207
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff