goautomate-ai commited on
Commit
492033d
·
verified ·
1 Parent(s): 168d18d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +176 -1
README.md CHANGED
@@ -1,3 +1,178 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: gemma
3
+ license_link: https://ai.google.dev/gemma/terms
4
+ base_model: google/gemma-4-E2B-it
5
+ base_model_relation: quantized
6
+ language:
7
+ - en
8
+ pipeline_tag: text-generation
9
+ library_name: gguf
10
+ tags:
11
+ - gguf
12
+ - ternary
13
+ - bitnet
14
+ - 1.58-bit
15
+ - gemma
16
+ - gemma-4
17
+ - quantization-aware-training
18
+ - distillation
19
+ - sovereign-ai
20
+ - edge
21
+ - efficient-inference
22
+ - llama.cpp
23
  ---
24
+
25
+ <div align="center">
26
+
27
+ # Terna‑E2B (GGUF)
28
+ ### A ternary (~1.6‑bit) distillation of Gemma‑4‑E2B · **Pre‑release** 🍁
29
+
30
+ **GoAutomate AI Institute — Canadian Sovereign AI**
31
+
32
+ [Organization](https://huggingface.co/GoAutomateAI) · [Website](https://www.goautomate.institute) · [Technical Report TR‑2026‑001](https://www.goautomate.institute)
33
+
34
+ </div>
35
+
36
+ ---
37
+
38
+ **Terna** is the GoAutomate AI Institute's family of **ternary‑weight** language models. The name comes from the Latin *terni* — "three each" — a nod to the three values every weight is constrained to: **{ −1, 0, +1 }**, the ternary representation at the heart of the family. That constraint is our defining bet: models that are **≈8–10× smaller** and **multiply‑free**, engineered to *subtract cost, not intelligence* — capable from the edge to legacy datacenter GPUs to modern accelerators. **Terna‑E2B** is the first member of the family.
39
+
40
+ ---
41
+
42
+ > ## ⚠️ Pre‑release checkpoint — read first
43
+ > These weights are an **early checkpoint trained on ~1B tokens**, published to demonstrate the method and invite community evaluation. They are **not a finished model.** Expect fluent‑but‑confidently‑wrong answers, and verify every output. **Production weights (~15B tokens) with full capability benchmarks will follow and replace this checkpoint.** We deliberately defer quantitative capability claims to that release.
44
+
45
+ ---
46
+
47
+ ## Model at a glance
48
+
49
+ | | |
50
+ |---|---|
51
+ | **Base / teacher** | [`google/gemma-4-E2B-it`](https://ai.google.dev/gemma) (capability‑dense, Western open‑weight lineage) |
52
+ | **Method** | Quantization‑aware **distillation** to ternary weights — *learned*, not post‑hoc rounded |
53
+ | **Weight representation** | Ternary — each weight ∈ **{ −1, 0, +1 }** (≈1.58 bits; ≈8–10× smaller than FP16, ≈2× smaller than 4‑bit) |
54
+ | **Format** | GGUF (`Q2_K`), runs on **llama.cpp** |
55
+ | **Language** | English |
56
+ | **Training tokens (this release)** | ~1B (pre‑release checkpoint) |
57
+ | **License** | [Gemma Terms of Use](https://ai.google.dev/gemma/terms) |
58
+
59
+ ---
60
+
61
+ ## What is ternary?
62
+
63
+ **Ternary** constrains every weight to one of three values — **{ −1, 0, +1 }** — which does two things at once:
64
+
65
+ - **Footprint collapses** to ≈1.58 bits per weight (log₂3), roughly an order of magnitude below half precision.
66
+ - **The multiply disappears:** `w · x` with `w ∈ {−1, 0, +1}` is just *add x*, *subtract x*, or *skip* — a general matrix‑multiply becomes a sparse signed sum, with ~⅓ of the work vanishing as structured sparsity.
67
+
68
+ Crucially, we reach ternary through **distillation** — training a ternary "student" to reproduce a high‑precision Gemma‑4‑E2B "teacher" — so the constraint is *learned*, not crudely imposed on a finished model. The guiding principle: **subtract cost, not intelligence.**
69
+
70
+ Full mathematics, methodology, and engineering are in **[TR‑2026‑001 — *Ternary Foundations for Efficient, Sovereign AI*](https://www.goautomate.institute)**.
71
+
72
+ ---
73
+
74
+ ## Files
75
+
76
+ | File | Size | Format |
77
+ |---|---|---|
78
+ | `terna-e2b-Q2_K.gguf` | ~3.6 GB | GGUF (`Q2_K`) — runs on **llama.cpp** |
79
+
80
+ ---
81
+
82
+ ## Usage
83
+
84
+ This is a standard **GGUF** and runs on [`llama.cpp`](https://github.com/ggml-org/llama.cpp).
85
+
86
+ **Quick test (CLI):**
87
+
88
+ ```bash
89
+ llama-cli -m terna-e2b-Q2_K.gguf -p "Explain what a mitochondrion does, in two sentences." --temp 0.7
90
+ ```
91
+
92
+ **Serve an OpenAI‑compatible endpoint:**
93
+
94
+ ```bash
95
+ llama-server \
96
+ -m terna-e2b-Q2_K.gguf \
97
+ -c 4096 --host 127.0.0.1 --port 8000
98
+ ```
99
+
100
+ Then POST to `http://127.0.0.1:8000/v1/chat/completions`. The **Gemma‑4 chat template** ships in the GGUF and is applied automatically when you use the chat endpoint.
101
+
102
+ ### Recommended generation settings
103
+
104
+ This checkpoint has a **low‑entropy** output distribution (very confident). For anything beyond short answers, soften it:
105
+
106
+ - `temperature: 0.7`
107
+ - a mild repetition penalty (e.g. `--repeat-penalty 1.2`) for long‑form generations, to avoid rigidity/repetition
108
+
109
+ ---
110
+
111
+ ## Intended use
112
+
113
+ - **Research and community evaluation** of ternary distillation and efficient serving.
114
+ - **Efficiency / systems experimentation** — edge, memory‑constrained, and legacy‑GPU serving where footprint dominates.
115
+ - Best behaved in **well‑covered domains**: general science, biology, medicine (educational), mathematics, and computer science.
116
+
117
+ ### Out of scope / not recommended (for this pre‑release)
118
+
119
+ - **Production or high‑stakes use** of any kind. This is an early checkpoint.
120
+ - **Unverified factual, medical, legal, or safety‑critical output.** The model is confident even when wrong — a human must verify.
121
+ - Long‑context or long‑form tasks without the softened sampling above.
122
+
123
+ ---
124
+
125
+ ## Limitations & known behaviors
126
+
127
+ Honest notes from our own evaluation of this checkpoint:
128
+
129
+ - **Confidently wrong.** High top‑1 confidence means errors are stated as fluently and assertively as correct answers. Do not treat outputs as facts without checking.
130
+ - **Low entropy → rigidity.** Peaked output distribution can make long generations repetitive or rigid; mitigate with the recommended sampling.
131
+ - **Echo‑loops on out‑of‑distribution inputs.** Limited chat‑format training means unusual phrasings or niche topics can trigger repetition/echoing. Stays healthiest in the well‑covered domains listed above.
132
+ - **English‑centric**, small effective size, and inherits any biases/limitations of the Gemma‑4‑E2B base.
133
+ - **Pre‑release quality.** Capability is not yet benchmarked; the production (~15B‑token) release is the intended quality bar.
134
+
135
+ ---
136
+
137
+ ## Training & method (summary)
138
+
139
+ The ternary student is trained under **quantization‑aware objectives** that align its outputs and intermediate representations to the Gemma‑4‑E2B teacher, so the { −1, 0, +1 } constraint is learned during training rather than applied afterward. Language‑model linear layers are ternarized; embeddings, the LM head, and normalization layers are kept at higher precision. Serving optimizations are held to a **token‑identical correctness gate** against a reference path, so throughput work never silently changes outputs.
140
+
141
+ Exact data mixes, hyperparameters, and kernel/encoding internals are held proprietary; the *methods and mental models* are described in the Institute's technical reports.
142
+
143
+ ---
144
+
145
+ ## About the GoAutomate AI Institute
146
+
147
+ The **[GoAutomate AI Institute](https://www.goautomate.institute)** is a not‑for‑profit advancing **Canadian sovereign AI** — accessible, responsible, Canadian‑governed models for organizations across Canada, with a focus on efficiency and on sectors where **provenance and governability matter** (healthcare, public sector, critical infrastructure). Ternary is our bet on the next wave of efficient AI: capability that scales **down** in cost as readily as it scales up in ability.
148
+
149
+ ---
150
+
151
+ ## License
152
+
153
+ This model is a derivative of **Gemma‑4‑E2B** and is governed by the **[Gemma Terms of Use](https://ai.google.dev/gemma/terms)**. By downloading or using these weights you agree to those terms. Gemma is provided under and subject to the Gemma Terms of Use.
154
+
155
+ ---
156
+
157
+ ## Citation
158
+
159
+ ```bibtex
160
+ @techreport{goautomate2026ternary,
161
+ title = {Ternary Foundations for Efficient, Sovereign AI},
162
+ author = {{GoAutomate AI Institute}},
163
+ institution = {GoAutomate AI Institute},
164
+ number = {TR-2026-001},
165
+ year = {2026},
166
+ note = {Pre-release; ternary-distilled Gemma-4-E2B}
167
+ }
168
+ ```
169
+
170
+ ---
171
+
172
+ ## Contact
173
+
174
+ Questions, evaluation feedback, or collaboration: **[info@goautomate.ai](mailto:info@goautomate.ai)** · **[goautomate.institute](https://www.goautomate.institute)**
175
+
176
+ <div align="center">
177
+ <sub>© 2026 GoAutomate AI Institute · Canadian Sovereign AI · Responsible Adoption · Public Benefit</sub>
178
+ </div>