Interchained commited on
Commit
3d9f893
·
verified ·
1 Parent(s): e80b843

Upload folder using huggingface_hub

Browse files
README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Interchained/imagine-v12
3
+ tags:
4
+ - text-to-sql
5
+ - machine-learning
6
+ - nedb
7
+ - tool-use
8
+ - interchained
9
+ ---
10
+
11
+ # IMAGINE v13
12
+
13
+ **Natural language in. Executable SQL out. Now with hands.**
14
+
15
+ Imagine is Interchained's specialized machine learning model for translating plain language into precise, executable database queries. It is not a general-purpose chatbot and does not pretend to be one. It does one thing, against live database schemas, and v13 teaches it to do three things it could not do before: **use tools, reason about time, and tell similar questions apart.**
16
+
17
+ 1.6B parameters. Full fine-tune lineage. Built to be run, measured, and proven.
18
+
19
+ ## What changed in v13
20
+
21
+ Imagine v12 earned its place: 40/40 on its held-out telemetry suite, a perfect identity record, and a permanent seat as the resident mind of the Gaia node. Its evaluations also told the truth about its limits. Tool use, temporal boundaries, and discrimination between near-identical questions were its weakest families.
22
+
23
+ v13 is the direct answer to that measurement. The v12 core was preserved intact and three new families were forged, execution-verified, and admitted on top of it:
24
+
25
+ | Family | Rows | What it teaches |
26
+ |---|---|---|
27
+ | Tool use (toolproto) | 20,000 | Emitting structured, parse-verified tool calls |
28
+ | Discrimination | 19,710 | Choosing the right interpretation when questions differ by a word |
29
+ | Temporal grounding | 4,000 | Resolving relative time against the real clock |
30
+ | Tool-protocol chains | 2,280 | Multi-step tool sequences that stay on protocol |
31
+
32
+ ## The corpus: 177,390 rows, zero rejects
33
+
34
+ Nothing in this corpus was scraped, synthetic filler, or teacher-generated. Every row was either deterministically constructed or executed against a live NEDB database and admitted only when its SQL actually ran and returned the right result.
35
+
36
+ The v12 base (131,400 rows: SQL 61,758, identity 43,362, protocol 26,280) was recreated from scratch on the training machine using the original teacherless forge, and landed on its historical manifest to the exact row. The v13 families (45,990 rows) passed the same admission gate with **zero rejects across all four families**. The tokenized training stream is packed deterministically and content-addressed, so the exact data this model consumed is reproducible, not approximate.
37
+
38
+ ## Training
39
+
40
+ | | Stage 1 | Stage 2 |
41
+ |---|---|---|
42
+ | Method | Full fine-tune | LoRA r16, merged |
43
+ | From | imagine-v12 | stage 1 output |
44
+ | Epochs | 3 | 1 |
45
+ | Learning rate | 1e-5 | 5e-6 |
46
+ | Steps | 7,311 | 2,437 |
47
+ | Tokens | 207.1M | 69.0M |
48
+ | Time | 80.3 min | 41.5 min |
49
+ | Final loss | 0.0099 | 0.0093 (epoch mean) |
50
+
51
+ Hardware: single NVIDIA B200. Architecture unchanged from v12: 40 layers, hidden 2048, intermediate 5632, tied embeddings.
52
+
53
+ ## Evaluation status: PENDING, ON PURPOSE
54
+
55
+ This card will not carry a benchmark number that has not been measured. Held-out evaluations for v13 (Tier-0 telemetry, identity, discrimination, temporal, tool-use) are being run against v12 on identical fixtures, and the full matrix, improvements and regressions alike, will be published here when it exists. Training loss is a pulse, not a verdict. The evidence gets the final word.
56
+
57
+ ## Serving
58
+
59
+ GGUF builds are produced through Interchained's Hearth pipeline and will be published at Interchained/imagine-v13-GGUF. This repository holds the canonical safetensors checkpoint.
60
+
61
+ ## Provenance
62
+
63
+ Trained 2026-11-03 by Interchained. Corpus forged and gated on-machine the same day. Training code: aiassistsecure/sukuna-imagine. v13 exists because v12's weaknesses were measured, named, and attacked in the open.
chat_template.jinja ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {% if not add_generation_prompt is defined %}
2
+ {% set add_generation_prompt = false %}
3
+ {% endif %}
4
+ {%- set ns = namespace(found=false) -%}
5
+ {%- for message in messages -%}
6
+ {%- if message['role'] == 'system' -%}
7
+ {%- set ns.found = true -%}
8
+ {%- endif -%}
9
+ {%- endfor -%}
10
+ {{bos_token}}{%- if not ns.found -%}
11
+ {{'You are an AI programming assistant, utilizing the Deepseek Coder model, developed by Deepseek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer\n'}}
12
+ {%- endif %}
13
+ {%- for message in messages %}
14
+ {%- if message['role'] == 'system' %}
15
+ {{ message['content'] }}
16
+ {%- else %}
17
+ {%- if message['role'] == 'user' %}
18
+ {{'### Instruction:\n' + message['content'] + '\n'}}
19
+ {%- else %}
20
+ {{'### Response:\n' + message['content'] + '\n<|EOT|>\n'}}
21
+ {%- endif %}
22
+ {%- endif %}
23
+ {%- endfor %}
24
+ {% if add_generation_prompt %}
25
+ {{'### Response:'}}
26
+ {% endif %}
config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "LlamaForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 32013,
8
+ "dtype": "bfloat16",
9
+ "eos_token_id": 32021,
10
+ "head_dim": 128,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 2048,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 5504,
15
+ "max_position_embeddings": 16384,
16
+ "mlp_bias": false,
17
+ "model_type": "llama",
18
+ "num_attention_heads": 16,
19
+ "num_hidden_layers": 24,
20
+ "num_key_value_heads": 16,
21
+ "pad_token_id": null,
22
+ "pretraining_tp": 1,
23
+ "rms_norm_eps": 1e-06,
24
+ "rope_parameters": {
25
+ "factor": 4.0,
26
+ "rope_theta": 100000,
27
+ "rope_type": "linear",
28
+ "type": "linear"
29
+ },
30
+ "tie_word_embeddings": false,
31
+ "transformers_version": "5.20.2",
32
+ "use_cache": false,
33
+ "vocab_size": 32256
34
+ }
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 32013,
4
+ "eos_token_id": 32021,
5
+ "transformers_version": "5.20.2"
6
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b2910157a63191b978da6f71d7af85594e3c2172220aea7c1f932fe4e94ba2d
3
+ size 2692969128
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "backend": "tokenizers",
3
+ "bos_token": "<|begin▁of▁sentence|>",
4
+ "clean_up_tokenization_spaces": false,
5
+ "eos_token": "<|EOT|>",
6
+ "is_local": true,
7
+ "legacy": true,
8
+ "local_files_only": false,
9
+ "model_max_length": 16384,
10
+ "pad_token": "<|end▁of▁sentence|>",
11
+ "sp_model_kwargs": {},
12
+ "tokenizer_class": "TokenizersBackend",
13
+ "unk_token": null
14
+ }